I’m developing a Unity3D application for Android, and I need to integrate a large language model (LLM). From what I understand, I would need to compile the LLM as a .so shared library to use it on Android.

Has anyone done this before or know of any LLMs that are already available in this format? Any advice on how to approach this or resources that might help would be appreciated.