Data Scientist by day, geek tech gamer junky by night.
11/09/2019
Here’s a copy of the code I have working for the OpenAI GPT-2 1558M model A couple of changes to the source code that were required to get it to execute: tensorflow-gpu==1.12.0 wouldn’t work, updated to: !pip3 install tensorflow-gpu==1.16.0 interactive_conditional_samples.py updated to: model_name=’1558M’ https://github.com/AmbiguousError/gpt-2/blob/master/gpt_2_1558M.ipynb
11/09/2019
I had to see what the GPT-2 1558M model thought of Death Stranding, here’s a Guardian article I sourced the first couple of paragraphs from: Death Stranding review – Hideo Kojima’s radically tough slow-burning epic Model prompt Death Stranding defies convention, focusing on “connection” over combat and (almost) removing the notion of restarting a mission when things go wrong. Case in point: I failed to plan a delivery route and…
11/09/2019
Excited to hear about the release of Open AI’s 1.5 Billion GPT-2 model, had to take it for a test drive. Couldn’t produce a trained model on my own text as yet, but I did manage to load the 1558M model into Google Colab and run a couple of conditional samples. I grabbed the text from a Guardian articles on the flooding in Doncaster: Severe flood warnings remain in Midlands…
05/05/2019
Great news from openai regarding their GPT-2 model, they’ve released their 345M parameter version 🙂 GPT-2 Interim Update, May 2019 We’re implementing two mechanisms to responsibly publish GPT-2 and hopefully future releases: staged release and partnership-based sharing. We’re now releasing a larger 345M version of GPT-2 as a next step in staged release, and are sharing the 762M and 1.5B versions with partners in the AI and security communities who…
04/06/2019
Thought I’d ask the Trump Tweets Fine Tuning model a few questions 🙂 All results un-edited Model prompt >>> build a wall to protect against new Mexican people breaking into our country! Wall at our Southern Border is being built by contractors @AgComm Partners & is expected to cost a fortune. So many red tape checks and approvals necessary to build a wall (not an easy task). In January our…
04/06/2019
Currently working on a new bot, gpt-2 117M Fine Tuned on Trump Tweets 🙂 Extracted tweet history from the Trump Twitter Archive, limiting the extract to solely Trump tweets. This gives me over 25k lines to fine tune a model on! It’s currently running and producing some interesting examples, and I can’t honestly tell if they are real or not??? Here are a few examples for now: I know plenty…