Update to latest upstream GPT-NeoX implementation / Fix GPT-NeoX inference

[philpax]

GPT-NeoX inference seems a little... funky, as reported by @LLukas22:

1: <|padding|>The meaning of life is the name.
“I was doing this for a while, and I knew it could make an impact,” says Coker about his time in college football coaching roles at North Carolina State University (NCSU) from 2004 to 2013 before going on to be head coach – again! -of NEC Conference’s Delaware Division of Basketball.
But then came the 2016-17 season, when he became a first year assistant for UNC women's basketball under Hall Of Fame Head Coach Sylvia Hatchell where Coker helped in leading her team through an historic NCAA National Championship run that saw them defeat Notre Dame

2: <|padding|>The meaning of life is the only way to be, or not at least a partialwayto-ofex: part_LATEX LAC PARTICIELPARTISTCORLECRECLPINORTHCAREBUT)
(Photo by Alex Wong/Getty Images), (Source: AP Photo / Evan Vucci)(AP Photos): President Barack Obama speaks about the proposed Keystone XL pipeline in Washington. A judge has given TransCanada Corp permission to build a controversial oil sands project that would cross an international border and run through US-owned land — but it was not clear Monday how long he will keep his word.(Photo by Evan Vucci/AP)
(Source: AP Photo / John Minchillo)(Reuters): Democratic presidential candidate Hillary Clinton holds up the key to a new office in her New York home. As she ha

3.<|padding|>The meaning of life is a short-post, post by an easy to use and detailed?PostByGetAButContinueEcheLIfYouTWhatIsIt?HowToBeginAfterGAtthes the details are too long for you (or just)
I’m not going anywhere. I am here forever; so it seems as if there is no end in sight—that life has run its course and that we will be back again at a later time to finish what was started, but our destiny? Maybe this story isn't over yet: After all the world keeps turning

This was captured with a RedPajama model.

[LLukas22]

The models i tested with will be uploaded to the following HF-Repos:
RedPajama 3B (GGML + GGJT versions): https://huggingface.co/LLukas22/redpajama-ggml
Gpt-Neox-20b (GGML only): https://huggingface.co/LLukas22/gpt-neox-ggml