Heat oil in a wok or large skillet over high heat. Add peeled and deveined shrimp and stir-fry for 2-3 minutes, until pink and cooked through. Remove from the pan and set aside. Add chopped asparagus and sliced bell peppers to the pan and stir-fry for 2-3 minutes, until tender. Add minced garlic and ginger and stir-fry for another minute. Add the shrimp back to the pan, along with soy sauce, oyster sauce, and a pinch of sugar. Stir-fry for another minute. Serve hot with rice or noodles.