Great news from openai regarding their GPT-2 model, they’ve released their 345M parameter version πŸ™‚ GPT-2 Interim Update, May 2019 We’re implementing two mechanisms to responsibly publish GPT-2 and hopefully future releases: staged release and partnership-based sharing. We’re now releasing a larger 345M version of GPT-2 as a next step in staged release, and are sharing the 762M and 1.5B versions with partners in the AI and security communities who…

Recently read that Chromium still has callbacks to Google, and here I was naively thinking that it was secure Still not sure if Brave makes these callbacks, but that’s tomorrows question 😜 Been using and enjoying @brave from launch on #Android and #linux Recently found that chromium makes call backs to Google, is this removed from Brave?#security — Gamer Geek (@GamerGeekNews) April 25, 2019 So all I keep Chromium about…

Spider-Man Odyssey

April 9, 2019

Recently picked up 2 new games for the PS4, Marvel’s Spider-Man and Assassin’s Creed Odyssey. I’ve had my eye on both for a while, and as the digital copies are on offer for Easter I thought I’d treat myself. I actually messed up, accidentally purchasing Marvel’s Spider-Man Deluxe Edition while trying to remove it from the digital cart… yeah my wife didn’t believe me either πŸ™‚ Sony refunded the cash…

Thought I’d ask the Trump Tweets Fine Tuning model a few questions πŸ™‚ All results un-edited Model prompt >>> build a wall to protect against new Mexican people breaking into our country! Wall at our Southern Border is being built by contractors @AgComm Partners & is expected to cost a fortune. So many red tape checks and approvals necessary to build a wall (not an easy task). In January our…

Trump Twitter Bot

April 6, 2019

Currently working on a new bot, gpt-2 117M Fine Tuned on Trump Tweets πŸ™‚ Extracted tweet history from the Trump Twitter Archive, limiting the extract to solely Trump tweets. This gives me over 25k lines to fine tune a model on! It’s currently running and producing some interesting examples, and I can’t honestly tell if they are real or not??? Here are a few examples for now: I know plenty…

Against my better judgement given issues with past pre-releases I’ve been running Ubuntu’s Budgie 19.04 Dicso Dingo Beta… & it’s awesome πŸ™‚ Everything working after an update using the terminal from Ubuntu 18.10. It seems slicker than usual, assuming this is due to the Memory and CPU optimisations featured in this update. I also like the new look and feel of the file manager. If you’d like to give it…

Tensorflow Hosking Bot

April 4, 2019

Given what I’ve learned over the past few days, and the success of the Trump bot, I thought I’d try modelling the Mike Hosking data again; extracts below πŸ™‚ This is certainly Hosking’s prose style, although the content matter doesn’t match perfectly. I chose the first question to match what I’d asked the Trump Bot to compare output; happy that it has changed and mirrors Mike build a wall ……

Tensorflow Trump Bot

April 4, 2019

Today I decided to try and turn the gpt-2 model to Trump’s speeches, and the results are scarily successful. Here is the file of the Trump 2016 Presidential Election Speeches that I used Prompts as titles, with generated Trumpesque speeches πŸ™‚ build a wall Build a wall to stop illegal immigration. I want to work with our allies to put the failed policies of the past behind us. We’ve spent…

gpt-t song samples

April 1, 2019

Here’s a collection of song samples from the fine tuning lyrics πŸ™‚ Really happy with this as a first cut, although I’d prefer less profanities, so looking to cut curate the import set. So what next? Want to try an see if I can create a new Beetle’s single, maybe try Tolkien poetry, and see how it does with limericks ======================================== SAMPLE 1 ======================================== ICM Rates Excess Mammalian Waste ICM…

I’ve pivoted with the theme for the text I’m using to fine tune openai’s gpt-2 model, and have picked up a few tips doing so, and I now have Tensorflow gpt-t writing songs πŸ™‚ Steps that I have worked through today: ingesting a collection of lyrics from various artists from a Kaggle soucre encoding and merging the files tweaking the train.py parameters This isn’t going to win any awards. The…