Let's go, shall we?

If you put it into the negative, the question part would remain the same:

Let’s not go, shall we?