To model data, it is usually important to know what things mean.
Are voting to vote and voting for the same person the same person - is it the same as no one is voting on things?
In any case, of course, it is possible (with appropriate indexing for performance) to have it in one table for ease of management. In addition to this base table, you can add UpVote and DownVote views. Or you could go the other way and have two base tables with one kind of vote for convenience.
, , - . , , , / ..
, , , .
, , . , -. , .