Yes you are right. If you cannot authenticate using the authorization server (i.e., skip client ID and secret), you will receive only a short-term access token.
Since the Angular code is on the client, it will not be safe for him to keep your client's secret. Therefore, you cannot transfer your client secret to the Auth server so that you cannot authenticate.
Also, your server code will not just save the token, it will have to place the endpoint that will accept the authentication code, and then call the Auth server with this code (and your client credentials) to get the token and update the token,
auth http , .