In this study we compare binary relevance assessments with assessments made on a 5-point scale using results from the search engines Bing and Google. We use 1,000 queries and the first 10 results of each query. The results show that there are no significant differences between the two different methods of assessment. Nevertheless, we recommend using 5-point scales as they allow for a more differentiated view of relevance assessment.