meaning - What is the origin of "Indian Summer" and is it offensive?

I am discussing San Francisco's "Indian Summer" and happen to be surrounded by people from India (the country).

As I was speaking I got terribly uncomfortable thinking I was offending someone, (there also is a person of Cherokee heritage behind me).

Is there any chance that me calling the weather an "Indian Summer" would offend anyone?