Instructions to use litert-community/Polaris-4B-Preview with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- LiteRT-LM
How to use litert-community/Polaris-4B-Preview with LiteRT-LM:
# LiteRT-LM runs on various platforms (Android, iOS, Windows, Linux, macOS, IoT, Web/WASM) # and supports many APIs (C++, Python, Kotlin, Swift, JavaScript, Flutter). # For platform-specific integration guides, please refer to the official developer website: # https://ai.google.dev/edge/litert-lm # To try LiteRT-LM, the easiest way is to use our CLI tool. # 1. Install the LiteRT-LM CLI tool: pip install -U litert-lm # 2. Download and run this model locally: # See: https://ai.google.dev/edge/litert-lm/cli litert-lm run \ --from-huggingface-repo=litert-community/Polaris-4B-Preview \ --prompt="Write me a poem"
- LiteRT
How to use litert-community/Polaris-4B-Preview with LiteRT:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
Hello :)
Hi β just letting you know this model is now available to download in Box, an open-source, fully offline on-device AI app for Android (Apache-2.0, forked from Google's AI Edge Gallery). Box runs LiteRT / LiteRT-LM alongside llama.cpp, so .litertlm models run natively with GPU/NPU acceleration where the hardware supports it.
It appears in the in-app model browser with attribution and its original licence, and downloads directly from this repo β nothing is mirrored or re-hosted.
Thanks for publishing it. If you'd prefer it not be included, or want the description or credits changed, just say and I'll sort it.
ok done
Hi, sorry if that came across as spam i was just letting several model creators i have featured there model in Box. π