Should I be doing more around the house?

That doesn't seem right to me that he expects you to clean his stuff when you don't live there full time. He should at least help you, but that responsibility is not solely yours.