Charity Lays Off Survey Architect

By Nacha Cattan

Published October 03, 2003, issue of October 03, 2003.
  • Print
  • Share Share

The chief architect of the controversial National Jewish Population Survey, Jim Schwartz, has been laid off by the survey’s sponsor, United Jewish Communities, according to sources close to UJC.

The philanthropy announced last week in an internal communication that Schwartz’s position as director of the North American Jewish Data Bank was being eliminated as part of a reorganization, several sources said. The data bank is jointly operated by UJC and Brandeis University.

The announcement came just days after the release of an external review that detailed a series of errors and missteps in the $6 million population survey. Questions about the survey’s reliability have mired UJC in controversy for the past year.

Schwartz declined to be interviewed for this article.

Schwartz had overseen the survey as UJC’s director of research, a position he assumed in 1997. Last January, however, the organization announced that he had been reassigned to the data bank. The announcement coincided with the release of a preliminary review of the survey by an internal review panel, chaired by the principal and vice-chancellor emeritus of McGill University, Bernard Shapiro, that found “limitations and qualifications” in the survey.

The population survey was initially released in October 2002 but was withdrawn three weeks later, after researchers raised questions about support data that appeared to be missing. Shapiro’s review committee was appointed in November. It reported in January that “a range of serious issues of conception, of data collection, and of analysis were present in the project.”

In April a new review committee was formed, made up of outside experts headed by Marc Schulman, past chairman of the American Association for Public Opinion Research.

The survey itself was finally released this past September 10. Its main finding, widely quoted in the press, was an American Jewish population totaling 5.2 million, which is 5% less than the 5.5 million total found in a similar survey in 1990.

The survey also reported that the Jewish community showed signs of increased involvement in Jewish activity and ritual, including a Jewish day school attendance of 29%.

The published survey noted that its estimate of a 5.2 million total population may represent an undercount, and UJC officials cautioned in interviews that its findings did not necessarily indicate a population decline. However, UJC’s Web site continues to feature news articles reporting the decline as fact.

The Schulman review, submitted to the UJC September 19, points to serious methodological flaws that may have led to an undercount and damaged the survey’s comparability with the 1990 survey. It also cited flaws in data collection and analysis that may “skew” the Jewish sample “toward being more strongly identified with Judaism” than the actual Jewish population, undercutting the survey’s report of a more observant community.

Researchers said this week that one little-noticed calculation error cited in the Schulman report appeared by itself to have reduced the Jewish population by as much as 100,000. The glitch amounts to just 2% of the 5.2 million total, but researchers say it may be a sign of things to come as they begin to comb through the errors described in the review.

According to the review, the survey erred in calculating the percentage of Jews in the overall population by misinterpreting the responses of those who declined to give their religion. Such respondents were classified as non-Jews and included in the overall sample, rather than being deducted as nonresponsive, as is customary in such surveys. As result, Jewish respondents were calculated as part of an artificially large total sample, reducing their proportion and leading to an undercount.

“If it was assumed they were all non-Jewish, I think it was a mistake,” said Ira Sheskin, who was a member of the survey’s National Technical Advisory Committee. “But it’s not a big mistake. These surveys were never made to be accurate to the 100,000.” Sheskin is a geographer at the University of Miami.

Schulman also cited other errors in the design of the questionnaire, data collection and calculation of results, all of which he said could have resulted in undercounting the Jewish population. In addition, he cited the data whose loss, due to a faulty computer program, set off the review process last year, saying it, too, may have caused an undercount.

Brandeis University is scheduled to hold a colloquium later this month to gauge the values and limitations of the survey, according to scholars connected to the data bank.

Sheskin said he regretted Schwartz’s departure. “Jim is a personal friend of mine,” he said. “He put a lot of work into this study. I wish the study could’ve finished with him at the head of it. I don’t know all the reasons why the decision was made. I don’t know where the blame really should lie.”

Find us on Facebook!
  • "How much should I expect him and/or ask him to participate? Is it enough to have one parent reciting the prayers and observing the holidays?" What do you think?
  • New York and Montreal have been at odds for far too long. Stop the bagel wars, sign our bagel peace treaty!
  • Really, can you blame them?
  • “How I Stopped Hating Women of the Wall and Started Talking to My Mother.” Will you see it?
  • Taglit-Birthright Israel is redefining who they consider "Jewish" after a 17% drop in registration from 2011-2013. Is the "propaganda tag" keeping young people away?
  • Happy birthday William Shakespeare! Turns out, the Bard knew quite a bit about Jews.
  • Would you get to know racists on a first-name basis if you thought it might help you prevent them from going on rampages, like the recent shooting in Kansas City?
  • "You wouldn’t send someone for a math test without teaching them math." Why is sex ed still so taboo among religious Jews?
  • Russia's playing the "Jew card"...again.
  • "Israel should deal with this discrimination against Americans on its own merits... not simply as a bargaining chip for easy entry to the U.S." Do you agree?
  • For Moroccan Jews, the end of Passover means Mimouna. Terbhou ou Tse'dou! (good luck) How do you celebrate?
  • Calling all Marx Brothers fans!
  • What's it like to run the Palestine International Marathon as a Jew?
  • Does Israel have a racism problem?
  • This 007 hates guns, drives a Prius, and oh yeah — goes to shul with Scarlett Johansson's dad.
  • from-cache

Would you like to receive updates about new stories?

We will not share your e-mail address or other personal information.

Already subscribed? Manage your subscription.