Comments (1)
Hi, the 15B model was trained on 600+ programming languages including TCL, here's the full list of languages: https://huggingface.co/datasets/bigcode/the-stack-v2/blob/main/language_stats.csv
The 7B and 3B though were only trained on 17 languages available in the paper
For FIM it's similar to StarCoder, you can use this code with the right tokens (they're different from SantaCoder, we use underscores instead of dashes)
from starcoder2.
Related Issues (17)
- format for inference in code completion HOT 6
- Clash in requirements for finetuning Starcoder2 HOT 3
- Better inference based on starcode2-3b model HOT 1
- support SPM mode for FIM prompts HOT 2
- Megatron model weights for StarCoder2-15B HOT 2
- Unlawful use of my code HOT 2
- "lm_head.weight" not in the parameters of Starcoder2-3B and Starcoder2-7B (Huggingface version) HOT 2
- Inquiry about Fine-Tuning Using Custom Code HOT 1
- CrossCodeEval Results for StarCoder 2
- [Q] Does this support fill-in-the-middle completion?
- What does "unique tokens" mean (in the paper) ? HOT 2
- What prevents you from throughly opensourcing? HOT 4
- Official Support for GGUF Quantization in BigCode Starcoder2 to Enhance Accessibility and Efficiency HOT 4
- Can't load StarCoder2-3B HOT 4
- Some weights of the model checkpoint at `finetune_starcoder2/final_checkpoint were not used when initializing Starcoder2ForCausalLM HOT 4
- what is the sft template? HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from starcoder2.