The weather is very cold, so the athletes insist on exercising.

Even though the weather is very cold, the athletes insist on exercising.

Although ... but ... can't be used in this sentence, because the subject is "athlete", you can use it if you put brackets in front. Although it was cold, the athletes kept on exercising.