Prime Minister Scott Morrison has doubled down on the Coalition government's stance to not overturn a law that bans the territories from legislating on voluntary assisted dying.

Opposition Leader Anthony Albanese was also asked whether a federal Labor government would make this a priority, but he would not put a timeframe on legislation to protect territory rights when asked if a bill would be put forward in the first 100 days.