Skip to content

feat: Add chatapi.akash.network to available list of model providers (FREE LLAMA API ACCESS!)#1131

Merged
mcp97 merged 2 commits into
elizaOS:developfrom
MbBrainz:main
Dec 16, 2024
Merged

feat: Add chatapi.akash.network to available list of model providers (FREE LLAMA API ACCESS!)#1131
mcp97 merged 2 commits into
elizaOS:developfrom
MbBrainz:main

Conversation

@MbBrainz
Copy link
Copy Markdown
Contributor

Relates to: -

No Tickets

Risks

Low, new model added

Background

Most developers don't have in-house hardware to run models like LLAMA3.1-405B and so they'll have some sort of server setup. This usually costs money, however there exists a free option today: chatapi.akash.network. This is an openAI api compatible api that runs standard LLMs like llama3.1-405B and llama3.3-70B for free!

The official announcement of the public release: https://x.com/akashnet_/status/1814018478845616362
You can get your api key here: https://chatapi.akash.network

What does this PR do?

Adds a new model provider to the list of model providers

What kind of change is this?

Features

Why are we doing this? Any context or related work?

Im a big fan of the work of akash.network and I've been using this service myself for a while now. Its great to have access to bigger models for testing without risking huge token spends on your personal creditcard

Documentation changes needed?

My changes do not require a change to the project documentation. The env variables are added in the .env.example including the relevant links to where to get the key and how it works.

Testing

I tested it by following the steps below and got the following result:
Screenshot 2024-12-16 at 3 35 14 PM

Where should a reviewer start?

Follow the test steps below (should be really easy!)

Detailed testing steps

Easiest way to test is to do the following:

  1. clone repo
  2. Go to https://chatapi.akash.network and request a new api key (no email required, optional)
  3. run cp .env.example .env in the root and set the api key here
    https://github.com/MbBrainz/eliza/blob/de87bfaa308091ff14ff488f5a446cf72b8904c4/.env.example#L234C1-L238C73
  4. change the model provider in ./packages/core/src/defaultCharacter.ts to modelProvider: ModelProviderName.AKASH_CHAT_API,
  5. run pnpm build & pnpm start
  6. send a msg and verify if the model is akash_chat_api and if it responds
    7 ✅

Discord username

MbBrainz

@MbBrainz MbBrainz changed the base branch from main to develop December 16, 2024 09:01
Copy link
Copy Markdown
Contributor

@mcp97 mcp97 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM - amazing that it is free thanks for doing this!

@mcp97 mcp97 merged commit d0ea220 into elizaOS:develop Dec 16, 2024
@MbBrainz
Copy link
Copy Markdown
Contributor Author

You're more than welcome! Looking forward to contribute more.

@odilitime odilitime changed the title Add chatapi.akash.network to available list of model providers (FREE LLAMA API ACCESS!) feat: Add chatapi.akash.network to available list of model providers (FREE LLAMA API ACCESS!) Dec 18, 2024
lalalune pushed a commit that referenced this pull request May 3, 2026
Add `chatapi.akash.network` to available list of model providers (FREE LLAMA API ACCESS!)
FranceFlapjack pushed a commit to FranceFlapjack/eliza that referenced this pull request May 16, 2026
Add `chatapi.akash.network` to available list of model providers (FREE LLAMA API ACCESS!)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants