Take a look at the index table VAKPA, you'd get much faster results if searching by Partner number. By default this table is filled in only for Sold-to, but it may also be activated for Ship-to (it's a configuration setting in SD).
Also keep in mind that technically Ship-to may be different at item level. Might want to run this by an SD consultant to make sure it's not a concern.