Stuck in "Let's finish setting up your PC" screen after latest Update.

After the hint by Reza_Ameri I tried to recover the PC with my recovery media that I created when I got the PC. I only booted into the recovery installation once, without actually initiating the recovery, restarted and booted into my default WIN10 installation again, which ended up fixing the error somehow. I have to note that beforehand I deactivated the Settings > System > Notifications & actions > Suggest ways I can finish setting up my device to get the most out of Windows option by booting into safe mode.

So the Steps to fix the Error I took were:

1. Boot into recovery Mode.

2. Start into safe mode with enabled network drivers

3. Deactivate the Suggest ways I can finish setting up my device to get the most out of Windows option (possibly also in Registry)

4. Boot into recovery mode again, select "Use a device"

5. Use a Recovery USB Stick and boot into the recovery installation. Maybe a Windows install medium works as well.

6. Once booted into the recovery medium, just restart again. After this the Windows never showed again (restartet thrice to test)

Just to be safe I suspended Updates for the next two weeks.