It turns out the tablespace "temptblspace" is a user-defined tablespace even if I did not create the tablespace. It seems to have been automatically created by azure at some point. After confirming the tablespace was not linked to any objects I simply dropped the keyspace and reran the upgrade utility. The upgrade succeeded this time.
For anyone having the same issues, these are the sql commands I used to figure out if I can safely drop this keyspace which was causing the upgrade utility to fail:
-- Precheck extensions to ensure no unsupported extensions
SELECT * FROM pg_extension;
-- Check tablespaces and physical locations
SELECT spcname, pg_tablespace_location(oid) FROM pg_tablespace;
-- Check for user-created tablespaces
SELECT spcname, spcowner
FROM pg_tablespace
WHERE spcname NOT IN ('pg_default', 'pg_global');
-- Check owners of the tablespace
SELECT t.spcname, r.rolname AS owner
FROM pg_tablespace t
JOIN pg_roles r ON t.spcowner = r.oid;
-- Validate no dependant objects on temptblspace
SELECT relname, relkind
FROM pg_class
WHERE reltablespace = (SELECT oid FROM pg_tablespace WHERE spcname = 'temptblspace');
-- DESTRUCTIVE: Drop the tablespace - Only run if absolutely necessary
-- DROP TABLESPACE temptblspace;