I would say memory because I have no problem attending to what I am doing.
I have additional attention problems in PEM, that relate to distractions, following a thread in reading or in a TV programme or coping with background noise, but not in a quiet room with only me the phone and the phone book.