Using SSH without a password

Is it possible to set up a Linux machine to use scp without using a
password? I have a server that needs to provide files for a set of very
secure systems and they only have ssh installed on them (no ftp, no telnet,
no rlogin clients or servers). For convenience of the users, can a
password-less scp be set up?

Thanks,

Brian