Publication database

In 2013, Trumpf, a global market leader machine tools from Germany, acquired the majority shares in JFY, a smaller machine tool manufacturer from China. With this acquisition, Trumpf wanted to enter the fast-growing low-cost segment of the market. Until then, JFY had performed very well on the Chinese market, but the company's success increasingly waned after the acquistion. Other Chinese competitors performed significantly better. After JFY even had to report losses for the first time in 2019, Trumpf changed the management at JFY. Under the new management, initial successes were achieved, but even two and a half years later, JFY still did not reach the profit targets which all business units at Trumpf had to meet. In a Trumpf management meeting in October 2022, a decision was therefore to be made as to whether JFY should remain part of Trumpf or be sold off again.

With the help of more than 700 reviewers, we assess the reproducibility of nearly 500 articles published in the journal Management Science before and after the introduction of a new Data and Code Disclosure policy in 2019. When considering only articles for which data accessibility and hardware and software requirements were not an obstacle for reviewers, the results of more than 95% of articles under the new disclosure policy could be fully or largely computationally reproduced. However, for 29% of articles, at least part of the data set was not accessible to the reviewer. Considering all articles in our sample reduces the share of reproduced articles to 68%. These figures represent a significant increase compared with the period before the introduction of the disclosure policy, where only 12% of articles voluntarily provided replication materials, of which 55% could be (largely) reproduced. Substantial heterogeneity in reproducibility rates across different fields is mainly driven by differences in data set accessibility. Other reasons for unsuccessful reproduction attempts include missing code, unresolvable code errors, weak or missing documentation, and software and hardware requirements and code complexity. Our findings highlight the importance of journal code and data disclosure policies and suggest potential avenues for enhancing their effectiveness.

© 2024, INFORMS