DiLoCo: Distributed Low-Communication Training of Language Models

arxiv.org

DiLoCo: Distributed Low-Communication Training of Language Models

arxiv.org

Even_Adder@lemmy.dbzer0.com to

Free Open-Source Artificial Intelligence@lemmy.worldEnglish · 11 months ago

You must log in or register to comment.

Chat

Free Open-Source Artificial Intelligence@lemmy.world

fosai@lemmy.world

Create a post

You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !fosai@lemmy.world

Welcome to Free Open-Source Artificial Intelligence!

We are a community dedicated to forwarding the availability and access to:

Free Open Source Artificial Intelligence (F.O.S.A.I.)

Have no idea where to begin with AI/LLMs? Try visiting our Lemmy Crash Course for Free Open-Source AI. When you’re done with that, head over to FOSAI ▲ XYZ or check out the FOSAI LLM Guide for more info.

Monthly Roadmap

October 2023

Add new guides and fine-tuning resources.
Build and collect community datasets.
Publish a fosai model on HuggingFace?

More AI Communities

AI Resources

Learn

Build

Serve

Fediverse / FOSAI

LLM Leaderboards

LLM Search Tools

LLM Evaluations

GitHub Projects

My GitHub Stars

Documentation Theory

The Diataxis Method

Visibility: Public

This community can be federated to other instances and be posted/commented in by their users.

2 users / day
2 users / week
27 users / month
4 users / 6 months
0 local subscribers
0 subscribers
26 Posts
47 Comments
Modlog