You could try to RP it, IDK. I mean, the "I lost my memories" bit kind of handicaps the RP, but I always felt like Durge is for people who wanna do a "I have an inner struggle" angst thing. I have nothing against it, it's pretty great as a way to relieve stress tbh.
I did wind up backtracking and am now playing my Durge a little less ALL MURDER ALL THE TIME. Trying to find the right balance between charming and psycho killer since he's a Bard.