05/05/2019
Great news from openai regarding their GPT-2 model, they’ve released their 345M parameter version 🙂 GPT-2 Interim Update, May 2019 We’re implementing two mechanisms to responsibly publish GPT-2 and hopefully future releases: staged release and partnership-based sharing. We’re now releasing a larger 345M version of GPT-2 as a next step in staged release, and are sharing the 762M and 1.5B versions with partners in the AI and security communities who…
25/04/2019
Recently read that Chromium still has callbacks to Google, and here I was naively thinking that it was secure Still not sure if Brave makes these callbacks, but that’s tomorrows question 😜 Been using and enjoying @brave from launch on #Android and #linux Recently found that chromium makes call backs to Google, is this removed from Brave?#security — Gamer Geek (@GamerGeekNews) April 25, 2019 So all I keep Chromium about…
09/04/2019
Recently picked up 2 new games for the PS4, Marvel’s Spider-Man and Assassin’s Creed Odyssey. I’ve had my eye on both for a while, and as the digital copies are on offer for Easter I thought I’d treat myself. I actually messed up, accidentally purchasing Marvel’s Spider-Man Deluxe Edition while trying to remove it from the digital cart… yeah my wife didn’t believe me either 🙂 Sony refunded the cash…
06/04/2019
Thought I’d ask the Trump Tweets Fine Tuning model a few questions 🙂 All results un-edited Model prompt >>> build a wall to protect against new Mexican people breaking into our country! Wall at our Southern Border is being built by contractors @AgComm Partners & is expected to cost a fortune. So many red tape checks and approvals necessary to build a wall (not an easy task). In January our…
06/04/2019
Currently working on a new bot, gpt-2 117M Fine Tuned on Trump Tweets 🙂 Extracted tweet history from the Trump Twitter Archive, limiting the extract to solely Trump tweets. This gives me over 25k lines to fine tune a model on! It’s currently running and producing some interesting examples, and I can’t honestly tell if they are real or not??? Here are a few examples for now: I know plenty…
05/04/2019
Against my better judgement given issues with past pre-releases I’ve been running Ubuntu’s Budgie 19.04 Dicso Dingo Beta… & it’s awesome 🙂 Everything working after an update using the terminal from Ubuntu 18.10. It seems slicker than usual, assuming this is due to the Memory and CPU optimisations featured in this update. I also like the new look and feel of the file manager. If you’d like to give it…
04/04/2019
Given what I’ve learned over the past few days, and the success of the Trump bot, I thought I’d try modelling the Mike Hosking data again; extracts below 🙂 This is certainly Hosking’s prose style, although the content matter doesn’t match perfectly. I chose the first question to match what I’d asked the Trump Bot to compare output; happy that it has changed and mirrors Mike build a wall ……
04/04/2019
Today I decided to try and turn the gpt-2 model to Trump’s speeches, and the results are scarily successful. Here is the file of the Trump 2016 Presidential Election Speeches that I used Prompts as titles, with generated Trumpesque speeches 🙂 build a wall Build a wall to stop illegal immigration. I want to work with our allies to put the failed policies of the past behind us. We’ve spent…
01/04/2019
Here’s a collection of song samples from the fine tuning lyrics 🙂 Really happy with this as a first cut, although I’d prefer less profanities, so looking to cut curate the import set. So what next? Want to try an see if I can create a new Beetle’s single, maybe try Tolkien poetry, and see how it does with limericks ======================================== SAMPLE 1 ======================================== ICM Rates Excess Mammalian Waste ICM…
31/03/2019
I’ve pivoted with the theme for the text I’m using to fine tune openai’s gpt-2 model, and have picked up a few tips doing so, and I now have Tensorflow gpt-t writing songs 🙂 Steps that I have worked through today: ingesting a collection of lyrics from various artists from a Kaggle soucre encoding and merging the files tweaking the train.py parameters This isn’t going to win any awards. The…
30/03/2019
Using Google’s CoLab [https://colab.research.google.com] I’ve fine tuned the gpt-2 117 model with an extract of text from a kiwi radio host, Mike Hosking I chose Mike not because I ever agree with his opinion, ‘cos he has a distinct writing style. Here’s a link to my GitHub with the files: https://github.com/AmbiguousError/gpt-2 CoLab is symbiotic with Google Drive, and during the fine tune process a large data set that has been…
29/03/2019
I must be a sadomasochist as last weekend I picked up Fromsoftware’s latest title Sekiro: Shadows Die Twice 🙂 As with the other titles I’ve played of theirs on the PlayStation 4 (Dark Souls 2 & 3, BloodBorne) the game play World and levels are in a league of their own, but nothing prepared me for the difficulty challenge 🙂 Now I wasn’t coming into this blind; I’ve recently completed…
22/03/2019
We’ve got to start moving a lot more slowly in the next couple years, because the community can be very toxic for anything we do, as well as the actual products at stake. That being said, I think the community is going to need some great leadership development. If you’re working on a project that has some really good data, the people running it will need people to explain what…
22/03/2019
“with this in mind,” said Dr. Eric A. Bowering, an associate professor of physics at UC Davis and a co-author on the paper. “It’s a very good way to learn about particles that cannot be detected in the real world.” Dr. Bowering and four colleagues studied the particles using lasers that were made with molten steel that was sandwiched by an extremely thin thin layer called a layer of carbon.…
21/03/2019
Another openai project I’ve been playing with is gpt-2: Code for the paper “Language Models are Unsupervised Multitask Learners” Synopsis, you give the bot a text extract and it responds 🙂 I’ve been through the process of creating a local Docker and running this script, I’m far from understanding the complexities bit here is a demo: python3 src/interactive_conditional_samples.py –top_k 40 Model prompt >>> I’ve been through the process of creating…
21/03/2019
I’ve been playing with a couple of openai projects OpenAI’s mission is to ensure that artificial general intelligence benefits all of humanity. We’re a team of a hundred people based in San Francisco, California. The OpenAI Charter describes the principles that guide us as we execute on our mission. I’m really intrigued by their retro gym projects; teaching an AI to play classic video games… although I haven’t tried this…
27/02/2019
I’ve been wanting to try the Ubuntu Touch phone OS since I heard of it pre-launch, although I’ve never had a device I can use it on; that is until a friend this week passed on his old Nexus 5 🙂 I’m so looking forward to giving this a try, and probably wouldn’t have picked up my OnePlus 6t id I knew this was coming… can’t wait for the day…
26/02/2019
Who doesn’t know PUBG now days? It has become the most downloaded game and has been played by not only the youngsters but even the middle-aged people are watched playing it. Even I found many of my office colleagues playing the same and spending lot of their time in office washrooms. You wont believe but many have started their own YouTube channel so that they can upload the PUBG videos…
17/02/2019
I’ve had an Android phone since the Nexus 1, and haven’t been able to get KDE Connect to work… until now 🙂 https://community.kde.org/KDEConnect Easy as installing KDEConnect from the Android Play store, and I grabbed KDE Connect for Ubuntu via Synaptic… I didn’t know the full name to install it via apt-get 🙁 Think I’m going to use it mose to move files between devices… although the shared clipboard could…
16/02/2019
Made a #RedDwarf Scutterbot from #Lego pic.twitter.com/ctnMADq911 — Gamer Geek (@GamerGeekNews) February 10, 2019 I was quite stoked with this achievement, only a temporary creation as we needed the base for a Sperm Whale 🙂
