- Issue created by @SocialNicheGuru
- π©πͺGermany marcus_johansson
It will not be in the AI core module, because we will be moving out all providers from core into contrib modules now :)
However if you want to either find people to do this or support it or want to support it yourself, I have no problems doing the initial development for you. I can however not support it, I have to many projects to support already. So, if I am to build it I need to know that there are at least two maintainers ready to take any support requests and bug requests coming in.
One place to look for other people to help you out are on the channels #ai and #ai-provider-maintainers.
Since it will not be a feature of the AI module, I'll switch this to a support request so we can see if someone else is looking for this provider and ready to help.
- πΊπΈUnited States SocialNicheGuru
Point me in the direction. what woudl it look like. should I look at the LLM Studio provider and make modifications based on the Jan.ai api?
- π©πͺGermany marcus_johansson
Without knowing jan.ai, LMStudio I think is the closest one. As long as its OpenAI compatible, which it looks like, it should be fairly easy and mostly copy and paste (see https://jan.ai/docs/remote-models/generic-openai).
You would need some way of either getting the models, I couldn't find anything on a quick google. If that is not available, the user has to fill in the models themselves, there is a generic way of doing this, you can see in Huggingface provider (or Azure provider).