The hardest part about improv is getting the audience to relax and enjoy themselves, because most improv is not very good, and the audience is nervous for the performers the whole time. Not that they don't even like the show, but they feel bad for the performers.