Whether to use "we" or "us" depends on whether we are the subject or object of the sentence. Use "we" if it's the subject and "us" if it's the object.
Example:
"Not only did we go to the museum, but we went to the park too."
"It was not only us in the restaurant."