Spaces:
Sleeping
title: BeeCoder Demo
emoji: 🐝
colorFrom: gray
colorTo: yellow
sdk: gradio
sdk_version: 3.28.3
app_file: app.py
pinned: true
license: apache-2.0
🐝BeeCoder Demo🐝
Code-Completion Playground 💻 with 🐝BeeCoder Models
This is a demo playground for generating Python code with the power of 🐝BeeCoder, a fine-tuned version of the tiny 101M base model on a dataset of pypi packages.
ℹ️ This is not an instruction model but just a code completion tool.
Intended Use: This app and its supporting model are provided for demonstration purposes only; not to serve as a replacement for human expertise. For more details on the model, please refer to the model card.
In our country, we say "To let 100M parameters model generate python script and not validate is like to let monkey fly a plane". So please be careful with the generated code.
Base Model Information
The base model, smol_llama-101M-GQA, was pretrained on a relatively few (< ~20B) high-quality tokens. It is tiny in size (101M parameters) but relatively powerful in performance. The training for the base model included datasets such as:
- JeanKaddour/minipile
- pszemraj/simple_wikipedia_LM
- BEE-spoke-data/wikipedia-20230901.en-deduped
- mattymchen/refinedweb-3m
You can find more information about the base model here.
Credits
This app is modified from a demo playground originally built for StarCoder by BigCode. You can find the original demo here.