A better way to phrase this would be, ‘Around what time should we meet?’ The person would respond with an estimated time interval to a relaxed question like this.
Or, ‘What time should we meet?’ The person usually responds with an exact time to a question like this.