Models/MahaMarathi-7B
MahaMarathi-7B mark

MahaMarathi-7B

Fine-tunedOpen-sourceमराठी

In plain words

MahaMarathi-7B is a Marathi-first model built for local news, content, and everyday writing. It is open-source and tuned to read and write natural Marathi, with English support alongside.

How to use it

Before you start
Prerequisites required to run the model locally

To run MahaMarathi 7B locally on your computer, the following requirements must be met:

  • Install and set up Ollama.
  • Ensure your computer has enough RAM to run the model you plan to download.
  1. For 3B models: Minimum 8 GB of RAM.
  2. For 7B–8B models: Minimum 16 GB of RAM.
  3. For 13B–32B models: Minimum 32 GB of RAM.
  • Quantised model: It is recommended to use 4-bit Quantized, K-measurement, Small model format. Easy to download and to run your system.
  • Storage: 5 to 20 GB of free SSD space to store downloaded model files.
  • Interface: Terminal or command line utility to run basic startup prompts.

No technical setup needed — anyone can try MahaMarathi-7B using below mentioned steps.

1
Downloading the MahaMarathi 7B GGUF file

Go to the MahaMarathi 7B GGUF file on Hugging Face. Click the copy icon next to the repository name to copy the model path. (See image below.)

2
Run the model in your terminal

Open a terminal window and run the following command and paste the copied GGUF repository as mentioned below:

ollama run hf.co/PASTE_THE_COPIED_HERE

Press Enter.

Note: After pasting the repository, your command will look like this:

ollama run hf.co/ThePradip/MahaMarathi-7B-4bit-GGUF


3
Wait for the model to load

Ollama will download and initialise the model. Once ready, you'll see the following prompt:

>>> Send a message (/? for help)
4
Start chatting

Type your message at the prompt and press Enter to interact with the model.

5
Exit the chat

To end the session, type:

/bye

Then press Enter.

Languages & scripts supported

Works in these languages, in both native script and Roman typing.

मराठी Marathi+ Roman & code-mixed

Strengths & limits

An honest look at what it does well and where it struggles.

Good at
Natural Marathi writing
Local news and content
Free and open to run
Marathi–English together
Where it struggles
!Mainly Marathi only
!Smaller than the largest models
!Up-to-date facts after training
!Complex reasoning tasks

About the maker

Who builds and maintains MahaMarathi-7B.

Marathi AI logo
Marathi AI
1 models

Marathi AI is a community group focused on open models for Marathi and nearby languages, building on leading open models to bring strong, free AI to Marathi speakers, local media, and small businesses.

Compare

More like this

Comparable models you may also want to try.