I think the length of the interview is important. If it is, say, 15 minutes to an hour long, then sure, stick around and see what happens.

All-day interviews can be draining/horrible experiences, especially when it has sunk in that you aren't getting the position, don't fit in and so on.