If the police are asking, you should refuse. Consenting to a search may allow the police to find something they can use against you later. If you refuse and they search anyway, your attorney may be able to challenge the use of any evidence obtained through the improper search.
People often feel the urge to comply with the police, or think that they cannot say “no”. If the police are asking, you should politely refuse.