No, you can’t use different nameservers for different subdomains. The nameservers tell the internet where the DNS for a domain (including its subdomains) is hosted.
To point a subdomain to another server, here are a couple of methods.
In your hosting panel (e.g. cpanel) create the subdomain
home.example.com. Then in DNS find the
A Record for that and change the IP address to the IP address of the amplify server.
Alternatively, in DNS, create an
A Record for the subdomain and set the IP address. Both methods have the same outcome.
You then must have
home.example.com set up on the target server.