sequelbox (t.d.a.g.)

posted an update 3 days ago

Post

1324

Just released: our newest version of Shining Valiant, powered by an all-new science-instruct dataset!

The model: ValiantLabs/Llama3.1-8B-ShiningValiant2
The dataset: sequelbox/Celestia

tell your friends! for everyone to use.

(more releases coming later this week! including an expansion of the sequelbox/Supernova generalist dataset.)

replied to their post 10 days ago

coming next: newest version of Shining Valiant + the new science-instruct dataset that she'll be using as a knowledge base. very excited for this!
after that more build tool releases :)

posted an update 10 days ago

Post

1208

NEW RELEASE!

- MOTH is a generalist chat model, using high quality synthetic data to improve general performance.
- Currently available for Llama 3.1 and Gemma 2, more models to follow in the future.

get the models:
sequelbox/Llama3.1-8B-MOTH
sequelbox/gemma-2-9B-MOTH

get the dataset:
sequelbox/Supernova

<3 for everyone to use <3

1 reply

·

posted an update 15 days ago

Post

707

the new version of Enigma, our code-instruct specialist, is out now:
- ValiantLabs/Llama3.1-8B-Enigma is trained on code-instruct and general chat data.
- the updated code-instruct database is available now as well: sequelbox/Tachibana

more to come soon!

posted an update 20 days ago

Post

821

new synthetic general chat dataset! meet Supernova, a dataset using prompts from UltraFeedback and responses from Llama 3.1 405b Instruct: sequelbox/Supernova

new model(s) using the Supernova dataset will follow next week, along with Other Things. (One of these will be a newly updated version of Enigma, utilizing the next version of sequelbox/Tachibana with approximately 2x the rows!)

posted an update about 1 month ago

Post

1601

NEW math-instruct model + dataset!

ValiantLabs/Llama3.1-8B-Cobalt is our new math-instruct model.
Trained using a synthetic math-instruct dataset generated with Llama 3.1 405b. Find the dataset here: sequelbox/Polytope

More to come soon :)

posted an update about 1 month ago

Post

852

NEW MODEL + DATASET! :)

Check out Enigma, our new code-instruct model:
- trained on synthetic code-instruct data created with Llama 3.1 405b
- high quality code-instruct within the Llama 3.1 Instruct format

The model: ValiantLabs/Llama3.1-8B-Enigma
The dataset: sequelbox/Tachibana

Enjoy! We've got more new datasets and models to follow soon.

posted an update about 1 month ago

Post

1688

Just released: Shining Valiant 2 for Llama 3.1 8b!

- the first SV at 8b size, using the best 8b model
- newest version of the SV dataset improves specialist knowledge and response consistency

3.1 70b will be coming but our next releases will focus on expanding the Build Tools lineup. Get ready for some open-source synthetic datasets made with 3.1 405, coming VERY soon :)

get SV2: ValiantLabs/Llama3.1-8B-ShiningValiant2

1 reply

·

replied to their post about 2 months ago

Shining Valiant for Llama 3.1 also coming tomorrow :)

posted an update about 2 months ago

Post

1326

JUST RELEASED: Fireplace 2 for Llama 3.1 8b Instruct!

Fireplace 2 is an 'expansion pack' of structured outputs you can request during your chat, using special request tokens to let Llama know you're looking for specific types of responses:
Inline function calls
SQL queries
JSON objects
Data visualization with matplotlib

ValiantLabs/Llama3.1-8B-Fireplace2

2 replies

·

posted an update 4 months ago

Post

1738

Llama 70b Instruct + function calling.
Fireplace-70b out now:

ValiantLabs/Llama3-70B-Fireplace

posted an update 5 months ago

Post

3051

Shining Valiant 2 is here!
Finetuned on Llama 3 70b.

Super excited to build with Llama 3 - more models to come soon :)

ValiantLabs/Llama3-70B-ShiningValiant2

1 reply

·

t.d.a.g. PRO

AI & ML interests

Organizations

sequelbox's activity