Does the business need to be physically located in Riverside?

No. You only need proper filing, a California-compliant business address, and accurate public records.