Following the recent success of the Netflix series Too Much, Lena Dunham has released her memoir, Famesick, which she is busy promoting in a series of interviews with international news outlets. In conversation with The Guardian, the actress and director talked about the difficulties she had on set with Adam Driver, who played her character Hannah’s on-and-off boyfriend in Girls.

The HBO series, which aired six seasons from 2012 to 2017, was a great springboard for Dunham, the project’s star and showrunner—but it was not without its rough spots. In Famesick, Dunham says Driver would habitually yell on set, once even throwing a chair against the wall next to her and puncturing the wall of his trailer with a fist.

“At the time, I didn’t have the skill to … it never entered my mind to say, ‘I am your boss, you can’t speak to me this way,’” she said. “And, at that point in my 20s, I still thought that’s what great male geniuses do: eviscerate you. Which is weird, because I was raised by a male genius who would never do that”—referring to her father, the painter Carroll Dunham. She admitted that she was deeply shaken by her experience with Adam Driver, so much so that she had some reluctance about casting men in subsequent projects. “There were years when I thought, ‘Can’t I just do projects with just women?’”