Downey recalled the filmmaker expressing to him, "Let's do it while rendering you devoid of your usual go-to things."