Epilepsy is characterized by repeated epileptic seizures, which are manifested in various ways and depend on the location and size of foci in the brain. Long-term seizures with secondary generalization can cause memory problems. Numerous studies demonstrate the connection of memory damage and lateralization in medial temporal lobe epilepsy (TLE). However, the results were not always consistent with the material-specific memory model. A possible explanation for these inconsistent data is the insufficient control of psychological variables that can affect memory. In most of the previous studies in persons with epilepsy, they were not controlled for their emotional states such as anxiety and depression. We used the Rey Complex Figure Test (RCFT) as a measure of visual memory, Beck's depression inventory as a measure of depressive symptoms, and the State-Trait Anxiety Inventory as a measure of anxiety in 57 consecutive participants. Our aim was to investigate whether there is difference in visual memory with respect to the left and right TLE, and whether the participants of different gender with higher anxiety and depression rates would achieve different results on visual memory. Persons with lower levels of depression achieved better scores in the Immediate and Delayed recall subtests of the RCFT. We also explored the potential gender differences. Testing differences between the persons with higher and lower anxiety levels did not reveal any significant differences in any of the measures tested.