In terms of an SQl server, you describe a small database. With the right design, SQL Server can process terrabytes data.
This does not guarantee that your current design may work well. There are many ways to create poorly executed t-SQL and many incorrect database design options.
If I were you, I would download the test data twice as much as you expect from the tables, and then start testing your code. Stress testing can also be a good idea. It is much easier to fix database performance problems before they go into production. Far, much easier!