Tensorflow gpt-t writes songs

31/03/2019

I’ve pivoted with the theme for the text I’m using to fine tune openai’s gpt-2 model, and have picked up a few tips doing so, and I now have Tensorflow gpt-t writing songs 🙂

Steps that I have worked through today:

  • ingesting a collection of lyrics from various artists from a Kaggle soucre
  • encoding and merging the files
  • tweaking the train.py parameters

This isn’t going to win any awards. The model is far from finished, both in processing and development. It has generated a variety of compositions, and here is the one I’m happiest with so far.

I’ll publish more when complete 🙂

created at: [899 | 4012.47] loss=3.04 avg=2.43

And then she got naked

She never did get naked
She never felt it out
And she never did get naked!

Aye aye she knew
But the other day
A young woman caught her foot
And she began walking
And soon she was naked
She never did get naked
And she never did get naked!
And now she’s in the park
She’s looking for the boy
The park’s got a bad reputation
For giving naughty boys bad looks
And giving naughty girls bad looks.

He’s a child, a baby
And he’s a star
And he’s always smiling
He’s always thinking
He said, don’t say this, you’re never gonna get
A true man who goes out in the street
He’s always walking
He’s always walking
And now he’s in the garden
He’s always thinking
He said don’t say this, you’re never gonna get
A true man who lives out
Outside of his window
He’s always thinking
He said don’t say this, you’re never gonna get
A true man who goes out in the street
He’s always walking
He’s always thinking
And now he’s in the garden
He’s always thinking
And now he’s in the garden
He’s always thinking

Now he’s in the flower
He’s always walking
He’s always walking
He can always be seen
(In the garden, in the garden)
He’s constantly thinking
He said don’t say this, you’re never gonna get
A true man who lives out, outside of his window

Now he’s in the flower
He’s always walking
He’s always walking
He can always be seen
(In the garden, in the garden)
He’s constantly thinking
He said don’t say this, you’re never gonna get
A true man who lives out, outside of his window

Now he’s in the flower
He’s always walking
He’s always walking
He can always be seen
(In the garden, in the garden)
He’s constantly thinking
He said don’t say this, you’re never gonna get
A true man who lives out, outside of his window

Now he’s in the flower
He’s always walking
He’s always walking
He can always be seen
(Outside of his window, in the garden)
He’s constantly moving
He’s always moving
He’s always moving
He’s always moving
He’s always moving
He’s always moving
He’s always moving
He’s always moving, outside of his window!

I’m not your average young man
I’m not your average young lady
I’m not your average old lady
I’m not your average old lady
I’m not your average old lady
I’m not your regular old lady
I’m not your regular young lady
I’m not your ordinary old lady
I’m not your ordinary old lady
I’m not your ordinary old lady
I’m not your ordinary old lady
I’m not your ordinary old lady
I’m not your ordinary old lady
I’m not your ordinary old lady
I’m not your ordinary old lady
I’m not your ordinary old lady.

I have done something wrong
If I’d had my way you would know
I never had a smile for some
If I could’ve I might have been the
Bride of yesterday

It’s a miracle
That the day has ever come
I never would have chosen life so
If I had a heart that was a lie

If I’d been a stranger to you
I would be sure to find
You in a town with a lot of people
A girl who never came to live
If I could have her, I might have done it for you
If I have my heart that I should have known

If you’re wondering
If I’d got the chance
If you’re wondering what it’s like
It’s a miracle
That the day has ever come
I never would have chosen life so
If I had my heart that was a lie

If I had a heart that was a lie
Then I’d be lucky in every way
If I could have, I might have done it for you
If I had my heart that was a lie

If I had a heart that was a lie
Then I’d be lucky in every way
If I could have, I might have done it for you
If I had my heart that was a lie
I never would have chosen life so
If I had my heart that was a lie

If I’d been a stranger to you
I would be sure to find
You in a town with a lot of people
A girl who never came to live
If I had my heart that I should have done it for you
If I had my heart that I should have done it for you

Ninja edit addition, one more to share 🙂

created at: [1499 | 6700.14] loss=2.21 avg=1.96

just do what I feel like do

Hey, hey,
“I remember that last time
In a place where the only music was in the house”

Hey, hey,
The sound of silence surrounds us
When we’re looking out over the lake
And we do search for a road
That leads us down a long dark road
Through the cold dark of winter nights
Through the sweet sweet sweet sweet sweet road
That leads us down this long dark road
Through the sweet sweet sweet sweet road
Through the sweet sweet sweet sweet road
Wish I could be somewhere, I’m not ’t here
It’s too late to stop now

Hey, hey,
You say you’re so tired
There’s no way I can make the same vow
There’s no way I’m gonna be here for you
Wish I could be somewhere, I’m not ’t here
It’s so late to stop now

Hey, hey,
You say you’re so tired
You know it’s coming on strong
It’s coming on strong
It’s coming on strong
Wish I could be somewhere, I’m not ’t here
It’s too late to stop now

Hey, hey,
(In a place where the only music was in the house)
Just to make sure you’d better see
You know that your dreams don’t always come true
Sometimes you can’t seem to keep your eyes closed

Hey, hey,
You say you just don’t know
About the road that leads to this big old forest
Wish I could be somewhere, I’m not ’t here
It’s too late to stop now

Hey, hey,
You say you can’t sleep tonight
Your eyes on the sky,
But you can’t tell what it’s all about
Wish I could be somewhere, I’m not ’t here
It’s too late to stop now

Hey, hey,
Don’t you ever let your eyes roam
You know some of what’s inside of you
Wish I could be somewhere, I’m not ’t here
It’s too late to stop now

Hey, hey,
Your smile, your words, the way they whisper
Wish I could be somewhere, I’m not ’t here
It’s too late to stop now

Hey, hey,
You say you want to be somewhere
You say you don’t have no one to turn your back
There’s a man who lives just across the road
The road of the road of the road of the road
Wish I could be somewhere
You want to see a road that leads you down
Wish I could be somewhere
You want to see a road that goes around your heart
Wish I could be somewhere, I’m not ’t here
It’s too late to stop now

Hey, hey,
You say you can’t sleep tonight
Your eyes on the sky, but you can’t tell what it’s all about
Wish I could be somewhere, I’m not ’t here
It’s too late to stop now

Hey, hey,
You say you can’t sleep tonight
Your eyes on the sky,
But you can’t tell what it’s all about
Wish I could be somewhere, I’m not ’t here
It’s too late to stop now

Hey, hey,
You say you can’t sleep tonight
Your eyes on the sky, but you can’t tell what it’s all about
Wish I could be somewhere, I’m not ’t here
It’s too late to stop now

Hey, hey,
Your smile, your words, the way they whisper
Wish I could be somewhere, I’m not ’t here
It’s too late to stop now

Hey, hey,
Your smile, your words, the way they whisper
Wish I could be anywhere, I’m not ’t here
It’s too late to stop now

Hey, hey,
Your smile, your words, the way they whisper
Wish I could be somewhere, I’m not ’t here
It’s too late to stop now

It’s too late to stop now

Hey, hey,
It’s too late to stop now
It’s too late to stop now

When I was a child, I couldn’t care for nothing more than a dream
I couldn’t wait to get to some other place
I never wanted to be anywhere
And if I did, I’d do anything for a chance
To get to some other place

‘Cause when you find yourself lost and alone
You don’t have to look far

Last one for the night

Faces are scared and confused

I’m tryna watch them get me
Cameras flash by
Themes get played out
Faces are scared and confused
I’m a product of the world around me
I’m just a mouse in the face of a world full of mice
Cameras flash by
Themes get played out
Faces are scared and confused
I’m a product of the world around me
I’m just a mouse in the face of a world full of mice
Cameras flash by
Ain’t in the wrong land,
In the wrong place at the right time
I promise I’m your worlds only fan
You’ll love me as long as I’m in your streets Cameras flash by
Themes get played out
Faces are scared and confused
I’m a product of the world around me
I’m just a mouse in the face of a world full of mice
Cameras flash by
Themes get played out
Faces are scared and confused
I’m a product of the world around me
I’m just a mouse in the face of a world full of mice
Cameras flash by
Themes get played out
Faces are scared and confused
I’m a product of the world around me
I’m just a mouse in the face of a world full of mice I’m so bored, so bored
Oh, oh, my love, this is the wrong place at the right time
Cleaning up, drilling down and around my body
But I’m still so bored by this beat
‘Cause I’m a mouse in the face of a world full of mice
They say you’re bad, I’m a product of the world around me
And I’m a product of the world around me
They say you’re bad, but I’m still so bored by this beat
‘Cause I’m a mouse in the face of a world full of mice
They say you’re bad, but I’m a product of the world around me
‘Cause I’m a mouse in the face of a world full of mice
We wanna ride ’em, ride ’em, ride ’em
We wanna ride ’em, ride ’em, ride ’em
We wanna ride ’em, ride ’em, ride ’em
We wanna ride ’em, ride ’em, ride ’em
We wanna ride ’em, ride ’em, ride ’em
We wanna ride ’em, ride ’em, ride ’em
We wanna ride ’em, ride ’em, ride ’em
We wanna ride ’em, ride ’em, ride ’em I don’t think I’ll ever see my future
I know it’s past, I’m sure it’s far future
This shit’s gonna be hard for the vest
For some reason I hate the past
But I still look good in them T-shirts with my name on it
And the seats are big enough to hold me
I wanna ride ’em, I wanna ride ’em, I wanna ride ’em
I wanna ride ’em, I wanna ride ’em, I wanna ride ’em
I wanna ride ’em, I wanna ride ’em, I wanna ride ’em
I wanna ride ’em, I wanna ride ’em, I wanna ride ’em
I wanna ride ’em, I wanna ride ’em, I wanna ride ’em I wanna ride ’em
‘Cause I can, I can, I can’t
‘Cause I can, I can, I can’t
I can, I can, I can’t No more talkin’ ’bout whatcha gon’ expect
Whatcha gon’ expect ’em, I ain’t been heard yet
Shawty be wildin’ and sayin’ “Bitch you know we gon’ bust you if you want”
That’s right, we’ll bust you if you want! ‘Cause I can, I can, I can’t
Can I, I can, I can’t
No more talkin’ ’bout whatcha gon’ expect
Whatcha gon’ expect ’em, I ain’t been heard yet
Shawty be wildin’ and sayin’ “Bitch you know we gon’ bust you if you want!”
That’s right, we’ll bust you if you want! ‘Cause I can, I can, I can’t
Can I, I can, I can’t
No more talkin’ ’bout whatcha gon’ expect
Whatcha gon’ expect ’em, I ain’t been heard yet
Shawty be wildin’ and sayin’ “Bitch you know we gon’ bust you if you want!”
That’s right, we’ll bust you if you want! Let’s take a ride ’cause I can’t be bothered
Let’s take a ride ’cause I can’t be bothered
We’re on the floor, we’re standing here
Let’s take a ride ’cause

But then I had to share this classic by Bowie & Perl? lol

thank my respect to my countryAnd you said it right out loud:

If a man had his way, we’d go down in flames

But a woman had her way, we won’t go down, oh

So I’ll say it one last time,

If a man had her way, we’d go down in flames
Oh, you’ve seen it a million times, oh

I think I’m going insane
I’m gonna have to give up on that dream
And turn to something other
I’ll just sit this way, and burn until I go insane, oh, I will go insane

[Perl]
Ain’t nothing wrong with it
I don’t know why, I don’t know why
I go down to every club in a half-sack, I’m looking at
The lights are on the edge of the club, I’m looking at
There’s a big sign, the lights are on the edge of the club
Oh, there’s a big sign
The lights are on the edge of the club
You can hear it, there’s a buzz
Can you hear it?

[David Bowie]
I’m trying to find my voice, there’s a big sign
And I’m looking in the mirror,
There’s a big mirror
With a big red dot on it
There’s a big sign, the lights are on the edge of the club
Oh, there’s a big sign
The lights are on the edge of the club
There’s a big sign, the lights are on the edge of the club
Oh, there’s a big sign
The lights are on the edge of the club
That’s all.
I’m trying to find my voice, there’s a big sign
And I’m looking in the mirror,
There’s a big sign
With a big red dot on it
There’s a big sign, the lights are on the edge of the club
Oh, there’s a big sign
The lights are on the edge of the club
That’s all.
It ain’t about sex, I don’t mean that. I’m talking about ‘how you wanna be’
How you gonna be a man on my end of this
If I go to court and get my man back
We gonna see if it’s just another game, like before
I just don’t play that game, cause I play it.
See I’ma play whatever, if it’s a game I gotta play.
I’ll be outa here playing ball, if it’s a game I gotta play(Man I gotta play)
I’ll be outa here playing ball, if it’s a game I gotta play(Man I gotta play)
I’ll be outa here playing ball, if it’s a game I gotta play
(Man I gotta play)
I’ll be outa here playing ball, if it’s a game I gotta play
(Man I gotta play)
I’ll be outa here playing ball, if it’s a game I gotta play
(Man I gotta play, gotta play)
(Man I gotta play)
(Man I gotta play)
(Man I gotta play)
(Man I wanna play, gotta play)
(I gotta play, gotta play)
(I wanna play, gotta play)
(I wanna play, gotta play)
(I wanna play, gotta play)
(I wanna play, wanna play)
(Man I gotta play, gotta play) [Hook: The Notorious BIG (Michael)]
I’m the one
Who
I’m like
Who is it?
I can’t remember the name
I am the one who got it
It comes to me
Never really knowing
If I’m gonna break it
I’m like
Who is it?
Who is it?
I can’t remember the name
How long can I keep it up
Can’t remember its happened
I’m a piece of that puzzle
With a handful like the shit that it is
I’m like
Who is it?
Who?
I can’t remember the name
No I’m not a piece of that puzzle
I’m just like the shit that it is
With a handful like the shit that it is
I’m like
Who is it?
Who?
I can’t remember the name
No I’m not a piece of that puzzle
I’m just like the shit that it is
With a handful like the shit that it is
I’m
Who is it?
Who?
I’m like Like a Man Without Attire
It’s Like A Man Without Suit
It’s Like A Man Without Attire
I’m Like A Man Without Attire
I’m Like A Man Without Attire
It’s Like A Man Without Attire
A Man Without Attire
A Man Without Attire
A Man Without