There are more opportunities to interact with dialogue agents by the spread of smartphones and smart speakers. However, the dialogue agents in these devices lack the ability to entertain people. Dialogues with these agents are not as enjoyable as talking with a close friend. In order for dialogue agents to provide enjoyment to people, the system needs to recognize and generate humor from the context of the dialogue. At the moment, it is not clear whether humor that includes contextual information during dialogue is funny or how contextual information affects the funny. Therefore, to construct a standard database for evaluating the fun of puns considering the dialogue context, we collected dialogues containing puns on Twitter. Using the collected dialogues, multiple people evaluated the fun. Moreover, we analyzed the characteristics of a dialogue context that affects the fun of puns.