You can't avoid it - if you leave it then it will be returned to the sender
Was it an eBay purchase - if so, and it is returned then they will have to pay you back as not delivered (if you open a case)
Why so much - what was the value of the item - if it was much less than they have marked it for and you have a proof of purchase (PayPal receipt) then you could try to claim the charges back - but you would have to pay the bill first