Roughly three years ago, Goldman Sachs Group Inc. looked like it had an edge in Wall Street’s race to master quantum computing.

The banking giant had assembled a handful of highly specialized scientists and partnered with Amazon.com to figure out how the nascent technology could be used to juice better returns for its raft of wealthy clients. They were shocked by what they found.