As an INFJ, I think they get along pretty well with us. I read something online about the 'grand miscommunication theory' - the INTP has someone whom they can share their ideas, imagination, and thought processes, while the INFJ feels like the INTP is opening up to them.
INTP: Huzzah! An intelligent person with whom I can tell my observations! And she actually understands what I'm trying to say!
INFJ: Huzzah! She's opening up to me and telling me her deepest thoughts! I feel so honoured and I want to be close to her too.
Ultimately, they are both correct