Are the results as good as Alpaca with LLAMA base?

Good point, I forgot about this.

Would switching the base pythia-12b model for llama-13b improve things?

Which chinese one?

Google wants you to think they are dangerous, so they can stifle the competition by getting regulations and restrictions on AI passed.

The problem with many of these AI Content detectors is they too often flag human written text as AI Generated.

This may be the size of the datasets, but i it's hard to say how many parameters will be needed for a good llm that's just really good at explaining code.

I wasn't very impressed with BLOOMZ. Responses seem short and optimized for Q/A style output. Perhaps Zero-Shot and single-shot worked better than Bloom, but Bloom seemed to produce better output for stories or writing in general.

I was only able to test the 6B models though, so not sure how the 176B models compare.

So with pruning and 8-bit quantization, are we able to run BLOOM-176B on a single GPU yet?

Based on my testing, none of the open source models are anywhere near as good as ChatGPT (or even davinci-03 .. the lastest GPT-3 snapshot).

I think open source models need more fine-tuning and some RL techniques applied to get anywhere close.