Use inner join to build the final itab ( My Assumption - Only two tables are involved, in the current scenario ).
Select a~mat1 a~field1 a~field2 b~ref_mat as newfield
INTO TABLE itab
from table1 as a INNER JOIN table2 as b
on a~mat1 = b~mat1
where a~mat1 in s_matnr.