user_data deforms non-latin letters when passed in

[DoctorEvil92]

I'm trying to pass some data into a handler function with user_data, I hope I'm doing it correctly. So, the data that is passed is originally:
{'pagination_state_key': 'run0https://www.supermaxi.com/catalogo/.json', 'desired_store_name': 'Supermaxi El Jardín'}

And what I get after loading it with dict(context.request.user_data) is this:
{'pagination_state_key': 'run0https://www.supermaxi.com/catalogo/.json', 'desired_store_name': 'Supermaxi El JardÃ\xadn'}

This is the log attached.

I'm not sure if I'm doing something wrong, the encoding on the original string should be utf-8 and seems to work fine by itself.

[Pijukatel]

Hello,

Could you please create a minimal reproducible example? I am not sure how to reproduce it.

Maybe modify this:

from crawlee.crawlers import ParselCrawler, ParselCrawlingContext

async def main():
    crawler = ParselCrawler()

    @crawler.router.default_handler
    async def handler(context: ParselCrawlingContext):
        context.log.info("Supermaxi El Jardín")
        context.request.user_data.update(key='desired_store_name', value='Supermaxi El Jardín')
        context.log.info(context.request.user_data)

    await crawler.run(["https://crawlee.dev"])

if __name__ == "__main__":
    import asyncio
    asyncio.run(main())

It could be something with your setup as I can see that even the Crawlee coloured logs are not properly decoded

[Pijukatel]

Also could please answer following:

• what OS are you using?
• which version of Crawlee?
• what version of Python?

[DoctorEvil92]

I'm using Windows 10, Crawlee 1.1.0, Python 3.14.0.
The red letters seem to be standard when running it with the native Python Shell, the request does seem to work and get data from the site, encoding with soup works just fine with displaying characters, but with user_data it doesn't seem to work properly.

Here's the minimal example

from crawlee.crawlers import BeautifulSoupCrawler, BeautifulSoupCrawlingContext
from crawlee import Request
import asyncio


async def main():
    crawler = BeautifulSoupCrawler()

    @crawler.router.default_handler
    async def handler(context: BeautifulSoupCrawlingContext):
        context.log.info(context.request.user_data)
        print(dict(context.request.user_data))


    # run it
    starting_points = [Request.from_url("https://crawlee.dev", user_data={"desired_store_name":'Supermaxi El Jardín'})]
    await crawler.run(starting_points)


if __name__ == "__main__":
    asyncio.run(main())

This is the result.

[Mantisus]

Thanks for the details!

It seems to be something specific for Windows, as I was able to reproduce it in my Windows environment.