Show HN: Jevgpt ā reinventing the wheel with another wheel
23 points - last Wednesday at 10:14 PM
Felt extra autistic today and made jev an autoregressive chatbot by classifier small token vocabularies.
https://github.com/giga-james/jevgpt
had some trouble getting it to explore enough token options so i did a small spec decoding pass to expand token vocab (jev as drafter and verifier lol)
it aint much and it aint honest work either
adityamishra241
today at 11:37 AM
Really interesting approach. Iām curious how much the verifier pass improves the output quality compared to just increasing the token vocabulary.
This is amazing. I don't think I fully understand how it works, but the core of having Jev (or some classifier), generate the words/tokens it's going to output by picking/classifying the words/tokens, is very cool
Where do you see the biggest potential improvement gains?