This is awesome, very cool! You mentioned OpenAI in another post - it's not that hard to use the GPT-2 model. Check out https://github.com/minimaxir/gpt-2-simple for a quickstart. Would be curious to see how the music generation goes if you re-train your data set against gpt-2.