(2) Are there any tiny (1-3b) models finetuned for coding available in GGUF format? : LocalLLaMA

[https://www.reddit.com/r/LocalLLaMA/comments/16csdq6/are_there_any_tiny_13b_models_finetuned_for/] - 2024-03-04 10:56:19 - public:mzimmerm

ai, code, generate, llm, model, newspeak, small - 7 | id:1489789 -

bigcode (BigCode)

[https://huggingface.co/bigcode] - 2024-03-04 10:50:02 - public:mzimmerm

ai, code, generate, huggingface, llm, model, newspeak, santacoder, small, starcoder - 10 | id:1489788 -

Research community developing various code models, small and big. Models may not be instruct

WizardLM (WizardLM)

[https://huggingface.co/WizardLM] - 2024-03-04 10:42:44 - public:mzimmerm

ai, code, generate, huggingface, llm, model, newspeak, small, wizardcoder - 9 | id:1489787 -

Another open source small (1B) model.

deepseek-ai/deepseek-coder-6.7b-instruct · Hugging Face

[https://huggingface.co/deepseek-ai/deepseek-coder-6.7b-instruct] - 2024-03-04 10:13:20 - public:mzimmerm

ai, code, generate, good, llm, model, newspeak, opensource - 8 | id:1489783 -

Another possible model. For coding capabilities, Deepseek Coder achieves state-of-the-art performance among open-source code models on multiple programming languages and various benchmarks.

LLaMA 7B GPU Memory Requirement - Transformers - Hugging Face Forums

[https://discuss.huggingface.co/t/llama-7b-gpu-memory-requirement/34323/6] - 2024-03-04 10:10:38 - public:mzimmerm

ai, code, generate, llama, llm, model, newspeak, train - 8 | id:1489782 -

With the optimizers of bitsandbytes (like 8 bit AdamW), you would need 2 bytes per parameter, or 14 GB of GPU memory.

stabilityai/stable-code-3b · Hugging Face

[https://huggingface.co/stabilityai/stable-code-3b] - 2024-03-04 10:05:36 - public:mzimmerm

ai, code, generate, llm, model, newspeak - 6 | id:1489781 -

Another potential model to use for Newspeak, but it is NOT open source. Adventage: 2.5B params, so should be usable in small GPUs

Can Ai Code Results - a Hugging Face Space by mike-ravkine

[https://huggingface.co/spaces/mike-ravkine/can-ai-code-results] - 2024-03-04 09:38:45 - public:mzimmerm

ai, code, generate, huggingface, llm, model, summary - 7 | id:1489779 -

Comparison of LLM models for coding

openchat/openchat-3.5-0106 · Hugging Face

[https://huggingface.co/openchat/openchat-3.5-0106] - 2024-03-04 08:41:50 - public:mzimmerm

ai, code, generate, huggingface, llm, model, openchat - 7 | id:1489775 -

Open source with lots of information. Uses Multiple undrelying models. Not sure how I would train for it

Welcome Mixtral - a SOTA Mixture of Experts on Hugging Face

[https://huggingface.co/blog/mixtral] - 2024-03-04 08:24:33 - public:mzimmerm

ai, code, generate, huggingface, llm, mixtral, model, newspeak - 8 | id:1489774 -

The Mixtral model is new, and seems to be good. Click on “Demo“ to test it

StarCoder: A State-of-the-Art LLM for Code

[https://huggingface.co/blog/starcoder] - 2024-03-04 07:43:17 - public:mzimmerm

ai, code, generate, good, huggingface, llm, model, newspeak - 8 | id:1489773 -

Article has comparison with other code-LLM models

huybery/Awesome-Code-LLM: An awesome and curated list of best code-LLM for research.

[https://github.com/huybery/Awesome-Code-LLM] - 2024-03-04 07:33:15 - public:mzimmerm

ai, code, generate, list, llm, model - 6 | id:1489772 -

Large language models and the rise of the AI code generators | InfoWorld

[https://www.infoworld.com/article/3696970/llms-and-the-rise-of-the-ai-code-generators.html] - 2024-03-04 07:14:23 - public:mzimmerm

ai, code, generate, language, model, program, review - 7 | id:1489770 -

Review of LLM specialized for code generation

OpenAI Codex - Wikipedia

[https://en.wikipedia.org/wiki/OpenAI_Codex] - 2024-03-04 04:38:12 - public:mzimmerm

ai, code, codex, generate, language, model, program - 7 | id:1489759 -

Model which generates code for Python, Javascript, Go, Shell, Perl, Swifg, Ruby, PHP

codellama (Code Llama) - Huggingface model for generating programs. Maybe can be used for Newspeak?

[https://huggingface.co/codellama] - 2024-03-03 08:48:06 - public:mzimmerm

ai, code, generate, huggingface, language, llama, model, newspeak, program - 9 | id:1489750 -

AI Code Tools: The Ultimate Guide in 2024

[https://codesubmit.io/blog/ai-code-tools/] - 2024-03-03 08:19:57 - public:mzimmerm

ai, code, generate, good, model, tool - 6 | id:1489745 -

AI Code tools : Good summary. Does not talk about which pre-trained model they use. One is gemini (bard) -> alphacode2

BigCode - Playground - a Hugging Face Space by bigcode

[https://huggingface.co/spaces/bigcode/bigcode-playground] - 2023-12-10 00:38:55 - public:mzimmerm

ai, bigcode, code, generate, good, model, newspeak, playground, software, starcoder - 10 | id:1485780 -

Look for models that could be used in Newspeak

yabs.io

Yet Another Bookmarks Service

Search

Results