Local AI-Provider

Features
1

I’m wondering if it is plannend/possible to connect JabRef also to a local ai-provider. My university (Humboldt-Universität zu Berlin) is hosting three different llms, and I’d be happy to use them (or any non commercial solution) instead of commercial providers.

Please vote if you support this proposal:

  • I would like to have this feature, too!
  • I don’t care.
0 voters
2

Hi this already possible! See our tutorial at:

If you encounter any problems, @ThiloteE or @InAnYan can probably help you more with the setup.

3

Hi! Yes, you can easily connect to a local AI provider!

We use a trick: we specify the AI provider as OpenAI and change API Base URL (in Expert settings) to URL of local provider.

But for that to work, your AI-provider has to be OpenAI-API compatible

4

Many thanks, yes, it works!