navarre.ai

ClarisTalk AI · the FileMaker AI podcast

EngageU Live: Talk about database hosting with Joey Grimaldi from ODI Tech

November 25, 2024 · 13 min · Matt Navarre and Cris Ippolite

Jump to transcript ↓

ODI Tech is the oldest of the FileMaker hosting companies, and has been hosting databases since the 90s. Matt and Joey talk about hardware, AWS, SSD tech, AI Hosting, and more.

Apple PodcastsSpotifyYouTubeAll episodes

Transcript

Transcribed by machine (whisper, large model), 2,253 words. Names and product terms are sometimes misheard; the audio is the record.

Claris Talk AI And also a little bit about AI, like how that comes into play for your life and what the impact that's going to be on actually hosting, for example. Sure. So to start off with the hosting company, how we came about, we started in 1998. We were one of the first hosting companies on-scene, it was us and basically Digital Forest, who's no longer around. As far as the hosting company goes, we've gone through so many changes following FileMaker. That's FileMaker's zone and so forth. And it's so interesting having the Linux cycle come full circle. Oh yeah, you were talking about FileMaker 5.5 Linux. Yes, yes. I don't know, I think we were one of the only licenses.

When did they, just to refresh my memory, switch back to Linux for server? What version? Technically 18, but it really wasn't, in my opinion, it wasn't rock solid tailed 19. Okay, okay. So a few years ago now. Mm-hmm. Yeah. Okay. Yeah. I couldn't switch fast enough from Windows. Yeah. Don't get me wrong. We obviously hosted in Windows because of the enterprise levels of hardware. Yeah. But for managing the Linux software, being comfortable in the Linux environment is... Yeah. Yeah. Reliability, speed, footprint. All of the above. All of the above. Yeah, yeah, yeah. I didn't switch to it because I wasn't as comfortable with Linux as I am with Windows. And I don't like Windows, but it's much more desktop-y than the Mac.

Not than the Mac, it's desktop-y. It's just older. It's somewhat like the Mac, so I was able to learn it and get by. Yeah, and you have a ton of clients. Your hosting plans start pretty reasonably. Yeah. $5 a month, I heard. Yeah. In fact, we were just having this conversation. about um we used to do shared hosting for the smaller companies which i'm i really am sad that that went away yeah with the multi-tenancy but um i understand it so now everybody is uh getting on a dedicated server uh they start at 69 dollars okay but multi-tenancy let's not let that one go yes came up yesterday in the keynote i don't really know what that's going to mean but the word multi-tenancy was used again i know i think it was talking about like some fairly far future thing with uh server but we'll see they were talking in in terms of multi-tenancy they were talking in terms of scalability yes and and how to have um how to have uh one server serving many clients to have the multi-tenancy in order to have scalability that's that's really where that might end with um studio i don't know if it's like yeah studio probably connect studio yeah yeah so not like docker and file makers or something like that nope nope that's totally different so you guys do uh your own hardware right you don't have correct you know you don't restart aws like a lot of other

hosting companies no yeah and that's one of the things that kind of differentiates us from from other hosting companies is that um we maintain and support all their own hardware the hardware is actually purpose built for file maker um machines i'm guessing probably not big gpus cpus okay no no uh so so a lot of we do virtualization um the the virtualization that that we stand up, we do dedicated services so that all the RAM and of course the hard drive and everything is dedicated towards that particular instance. And then we have nodes and clusters so we have failover and everything's enterprise level. As far as physical hardware, is that what you're asking? Like what brand? Well, I just am curious because that's so outside of my area. For those people who know Supermicro, it's kind of an industry standard okay um it's all enterprise level hardware so you're talking we're talking everything multiple nicks multiple uh power supplies it's just enterprise level stuff so if a node goes down for instance if if you're um if your instance is hosted on a node and that node happens to go down it will then reboot on a another node and all psyquest drives for storage yes it's all scuzzy

i think i hope a few people get that joke but that's um yeah in fact we were rolling out uh nvme drives right now oh uh which is it's insanely fast so so as we kind of get through our hardware we're um we're migrating our hardware out to all nvme so that's uh oh yeah yeah it's like the more of a ram style it's like the super next generation of so ssd was like our big ssd was a huge jump for in performance and now we're going to the NVMe. - Is it actually like a totally different idea than SSD? - No, it's very similar. I think it's much faster as far as performance and for databases obviously, that's really where the bottleneck is. The bottleneck is in the disk.

So the NVMe makes a huge difference. We can also do block storage now. So if we wanted to take an NVMe drive and attach it to an instance, can do that and so for some people like to have um the os and the data partitions also yeah it's less of a big deal with one x i think it's a best practice for windows but yeah yeah um we can also do um virtual private clouds now for people so we do that with uh doing vpns for instance for hipaa compliancy for hospitals and that kind of thing so we'll we'll stand up a a side-to-side vpn for those people so that they can access their FileMaker database and other resources if they need to do like remote desktop we can do I know a lot of people that was actually my question if you do like Citrix or remote desktop that's mainly on a case-by-case basis so we don't we don't do that we don't kind of advertise that I guess it's a real specific type of a FileMaker thing right like a really big application that's mature but it would take a fortune to retool the application for win exactly performance yeah yeah and it's just much easier to yeah yeah so uh ai in fact uh somebody named yeah but we just we just did that up for them um and not even uh it's kind

of interesting um this is something that we don't don't host per se um but they're sage accounting software and we put that in the cloud in their own private cloud along with their font maker server and they decide to site connection with their own private cloud okay so now that we can integrate filemaker um on the same network as the sage yeah yeah so uh like for family developer developing ai with api calls that might not really have much of a impact you know it's sort of at a different level but what what are you getting from customers about it uh as far as doing things with api calls Well, no, like what other requests you're getting for AI and what other things you're doing in that API calls to AI?

You know, the FileMaker community, I'm really glad that this is happening. Because, like I always say to you, I come from this from a totally different background. So from a computer science background, having programmed in Objective-C and others, coming into FileMaker. Pascal, all the modern ones. All the really modern ones. - Go ball. Having, coming into this from that perspective, I tend to be an outsider, so to speak, with fine maker. In fact, I was just speaking with another person who is here about wanting to do a session specifically on how everything is not a nail, right? When you only have a hammer, everything looks like a nail. - Yeah, exactly. And sometimes as FileMaker developers, if that's all we know, we kind of get trapped into that, where we want to make everything in FileMaker.

Weirdly, I think that's one of the exciting things about AI. Because the cases for it are so attractive to do and also so easy to implement. Right. And that's really where FileMaker shines. Because FileMaker is really a Swiss Army now. I think this AI push is really getting the developer community to think outside of FileMaker and start looking at resources outside of itself. And that obviously happened with being able to make API calls from the script step. That's where all that started. But I think the AI is really pushing the developers in that direction, which I think is fantastic. So I guess one thing that occurred to me from seeing the stuff I've seen here is using, So rather than using, like, OpenAI for semantics or some things like that, to spin up your own model on, like, a local server, which kind of is kind of obvious.

So if you have a farm-like server, you could do a VPC kind of thing. Yeah. But that's a total GPU type, very, very different type of a server. Are you getting requests like that? Not so much now. I think after, you know, we've engaged and this now engaged you, being so focused on AI, I think we're going to start seeing that. Yeah, I think so too. Yeah, yeah. I hope so. Yeah, you know, and they're all, again, with looking outside of FileMaker, there are a lot of services out there that you can stand up, you can stand up these models in a matter of minutes. Pinecone, things like that. Yeah, yeah. After databases. Yep, and you can choose, and a lot of it, in fact, is freely available.

You just have to stand up a server to make calls to and do it. So, but like a lot of people have privacy issues or other issues with using like open AI for stuff like that. Or bank them, because you don't have control over everything. But if you have your server, like you, I like, you know, I get an open source model. I need a place to host it. You can't host it on your local computer. It has to be like where your frown server is. That's why I was thinking it would be kind of a natural offering. It could be, but there are things that are out there. I'm thinking over the, oh, the Huggy Face? Huggy Face, yeah. So are there, I guess I don't know, I should know more about it, but are there places you can actually host that where there is no risk of anybody else having access to it?

Oh, yeah, absolutely. You can choose models. They have a whole library of models that's all community-based, or you can make your own. You can supply it with the grade cell. You can make your own models. You can take models. But you still have to have a server to host it on. That's what I'm talking about. No, but they do. You can do it, right? Directly from that interface, you can basically say, build me a server. It'll build you a server within like two months. Okay. And then it'll also give you the API. Got it, got it. It'll also give you the URL to make the API calls. And then from FileMaker, you just go do it. Let me have some of that. Yeah. I want to play with some of that.

I will. It's actually a lot of fun. And with some of those in the community, you can basically search. There's like over, I think it's over a billion now, large language models. So you can search all of these for whatever subject you want. And then you can find the ones, and they're all rated, too. They're community rated. So you can look for one that you want, and then you can take that, and a lot of them will give you the data set that they used to make the model. Oh, wow. Yeah. And so it'll give you a CSV file, and you can look at that data, or if it's images, they'll give you images. You can look at that data set, and then you can add to that data set yourself and then have it learn that new data set.

So you're basically modifying... Yeah, yeah, yeah, yeah, yeah. So I think there's a few different approaches to that. Like, basically, what is the source of truth? Right. Chris and I talk about it a lot on the podcast. Because you can't trust the model to be the source of truth. The model is the logic engine to get from the prompt to the truth. Correct. And keep in mind that you also have, within that framework, you also have agents. And you can bring in other ones as well. So I think it's a really good way to do it. because you can use it as a starting point and then you can add your own data into it to basically refine those answers to make sure that you're getting the correct answer.

Yeah, it's a brave new world, man. I'm loving this. I can't wait. Thanks, Jerry. Yeah, thank you.

Back to top ↑

Have something to share?

Join me for a conversation on ClarisTalk AI.

Schedule a recording →