I think ultimately it's fair to be slightly skeptical of the stuff that scientists put out, but there also needs to be an aiding realization that there is almost always a rigorous research-related requirement that goes into producing grand predictions. Often this gets conflated with whatever the loudest person shouts into the media, which makes it a very partisan issue, because people have to pick sides and American politics closely relate political affiliation with cheering for a sports team.
Regardless, while I certainly agree that many of the things climate-scientists propose will have a negative effect on the economy in the short term, there appears to be very real consequences to what we are doing. Again, I do not want to assert that the world is ending, but given our understanding of the natural world the possibilities are endless and terrifying.
Let's say, for the sake of the argument, that you accept that the Earth is under an unusual period of warming, whether that is due to humans or not is slightly irrelevant (but we can observe that periods in Earths history where the climate was at its hottest are directly correlated with CO2 content in the atmosphere, and the recent heating period can also be directly correlated with our entrance into the Industrial revolution and extensive globalization). As the amount of CO2 increases in the atmosphere, we see a lot of direct changes, even if they happen over a few hundred years.
The first and most popular is global heating - as chemistry dictates, CO2 along with other, lesser related gasses are better than oxygen at trapping heat within the atmosphere. But the far scarier second result of increased atmospheric CO2 is Ocean Acidification. Essentially, the oceans are very good at absorbing carbon from the atmosphere, and end up absorbing something like 40% of the carbon dioxide released by human activity. This carbon reacts with salt water (primarily) in order to form carbonic acid, constantly shifting the pH spectrum of the worlds oceans towards the acidic end. We've already seen some of the results of this, as the oceans pH has decreased from 8.25 to 8.14 since the mid 1700's. The effects can even be localized, like the degradation of Australia's coral reefs.
Unfortunately for us, the run-away result of Ocean Acidification is, obviously, the extreme acidification of the oceans. Algae, one of if not perhaps the most fundamental organism to the oceans ecology, relies on the alkaline pH of the ocean to continue its metabolic process. However, while it would be devastating to the oceans ecology if Algae were to become extinct, it would also almost certainly mean the mass-extinction of land animals, as not only does the ocean provide the fundamental basis of the food period (one way or another) for many animals, Algae also produce something like 70% of the oxygen in the Earths atmosphere. It is important to consider too that once we begin to see the effects of ocean acidification, it is already far too late to do something about it.
Fortunately for us, it appears that even with relatively moderate climate change accommodations in the coming decades will allow us to avoid this utter catastrophe. But if we were to not alter our path at all - and see a 4 degree Celsius raise of global temperatures by the end of the century, I think its clear that life as we know it would cease to exist. There are no easy solutions to climate change. That, I think we can all agree on. However, investment in renewable energy sources, nuclear, and even fusion have shown and will continue to show returns both environmentally and economically. If we cannot agree on the facts of climate change, at least accept the clear economic stimulation that will come from the continued research and investment into these fields. The bottom line here is that if we, as a species, decide that it is important to prevent the formidable effects of climate change - what are the consequences? Economic downturn for less than a decade as we phase out previous energy sources and retrain the populous into new endevours? Then, even if we're wrong, we will have established a new age of energy production and there is no reason for the economy not to respond and grow once again in that scenario.
