Fix race condition that have the spec cached if .swagger() is called before ready()

[mcollina]

Checklist

• [x] run npm run test and npm run benchmark
• [x] tests and/or benchmarks are included
• [x] commit message and code follows the Developer's Certification of Origin and the Code of conduct