See this useful Wikipedia explanation:
"A point of contact (POC) or single point of contact (SPOC) is a person or a department serving as the coordinator or focal point of information concerning an activity or program."
You have not provided a full context, but in a business situation, your contact point could be your secretary, your personal assistant or yourself. There could also be different contact points for different purposes. For example:
For appointment time and venue: departmental secretary
For getting through security clearance upon his arrival at the gate: [whoever is the right person according to your house rules]
For pre-meeting exchange of discussion drafts: your general counsel.
If you are serving a boss or a team, then you may yourself be the primary contact point.
Anyway, it depends on your house rules and your oen judgment of how much you want yourself to be in control of information flow. The price of such control is that you become a clearing house or a general railway station.