This must be worrying you quite a lot, and in these situations it is always best to see your physician. The good news is that it is very unlikely that you have contracted this virus, as it is spread by mucosal contact. One could construct a scenario where your colleague had a part of her oral mucosa touching her phone, with your own use of her phone giving you oral mucosal contact at exactly the same place but this is both highly improbably and unlikely. You cannot get HSV from casual skin to skin contact from hand to hand. In addition, HSV-1 and HSV-2 can both affect oral and genital mucosa. From the interaction you describe, the only type of infection to which you could possibly have been exposed (even though it is highly unlikely) is an oral infection. If your colleague did not specify where she has had HSV outbreaks, this makes your possible exposure even less likely.
However, anytime you are worried about a possible risk to your health, the best thing to do is always see your physician right away. He or she can go over the entire scenario with you and help put your mind at ease about any possible risk. If you do have any outbreaks or skin changes, he or she can also help evaluate that.