Running Open-Source AI Models Locally With Ruby | reinteractive
G’day Rubyists. I’m currently working with a client on implementing a custom AI solution using an open source AI model. The reason for this is the client has very sensitive customer information and we don’t want to pass this across to OpenAI or other proprietary models, in order to maintain a very high level of security.The solution has been to download and run an open source AI model in an AWS virtual machine, keeping the model completely under our control, with the Rails application making API calls to the AI in a safe environment.I wanted to share with you how to download an open source AI model locally, get it running and run Ruby scripts against it.
Running Open-Source AI Models Locally With Ruby | reinteractive #ruby #rubydeveloper #rubyonrails #ai