Luke Williams says he was "annoyed" with Swansea City's approach after seeing his side come from two goals down to draw 2-2 with Portsmouth.