- Issue created by @ressa
- Status changed to Closed: won't fix
9 months ago 4:12pm 22 February 2024 - 🇩🇪Germany marcus_johansson
Already is being worked on here: https://www.drupal.org/project/ollama →
- Status changed to Active
9 months ago 7:45pm 22 February 2024 - 🇱🇹Lithuania mindaugasd
Since issue belongs within ollama issue queue, I changed the project.
@Orkut Murat Yılmaz integration can reuse some code from Hugging face module https://www.drupal.org/project/huggingface →
Module issue: ✨ Add support in AI Interpolator for Hugging Face Fixed - 🇩🇰Denmark ressa Copenhagen
I see that @Marcus Johansson joined the project recently, and that @Orkut Murat Yılmaz made some commits, which is great! Is a release close, or perhaps it can be tested already now?
The
llama3
model works well for me in Ollama, and it would be awesome if Drupal supported at least one self-hosted LLM. - 🇱🇹Lithuania mindaugasd
@ressa
would be awesome if Drupal supported at least one self-hosted LLM
I think this other module supports it already https://www.drupal.org/project/lmstudio → . Would you up to test it?
lmstudio is integrated with LLM provider → , and module maintainer @seogow is also working on AI interpolator support at the moment.
As per this issue ✨ Collaboration with existing projects Active , ollama could also be integrated with LLM provider the same way, and by extension, with AI interpolator.
- 🇩🇰Denmark ressa Copenhagen
Thanks for the tip about https://www.drupal.org/project/lmstudio → @mindaugasd, it looks great!
I guess I should run Ollama with
ollama serve
and then use Ollama's IP to connect it to the LM Studio module?And thanks for the link to the issue about collaboration between existing LLM projects, that would be very nice. There are a lot of moving parts to keep track of :)
- 🇩🇰Denmark ressa Copenhagen
I tried the LM Studio module, but it's not clear to me how to actually use it -- I can't add a LM Studio block, there are no new LM Studio fields ...
- 🇱🇹Lithuania mindaugasd
In case you seek AI interpolator support with lmstudio, @seogow is developing it, but there is non yet. With this patch ✨ Proposal for Implementing LLM Abstraction in OpenAI Drupal Modules Active possibly you can get it working with features of OpenAI module.