First limit permissions on the ftp home directory to allow read and download capabilities
# chmod 540 ftp_home/
Then to any file added I make read only
# chmod 444 ~ftp_home/file
This should allow the user(s) to view files available to download without them being able to remove or alter the file nor able to upload additional files.