Skip to main content

Nixon Peabody LLP

  • People
  • Capabilities
  • Insights
  • About
Trending Topics
    • People
    • Capabilities
    • Insights
    • About
    • Locations
    • Events
    • Careers
    • Alumni
    Practices

    View All

    • Affordable Housing
    • Community Development Finance
    • Corporate & Finance
    • Cybersecurity & Privacy
    • Entertainment & Media
    • Environmental
    • Franchising & Distribution
    • Government Investigations & White Collar Defense
    • Healthcare
    • Intellectual Property
    • International Services
    • Labor, Employment, and Benefits
    • Litigation
    • Private Wealth & Advisory
    • Project Finance
    • Public Finance
    • Real Estate
    • Regulatory & Government Relations
    Industries

    View All

    • Aviation
    • Cannabis
    • Consumer
    • Energy
    • Financial Services
    • Healthcare
    • Higher Education
    • Infrastructure
    • Manufacturing
    • Nonprofit Organizations
    • Real Estate
    • Sports & Stadiums
    • Technology
    Value-Added Services

    View All

    • Alternative Fee Arrangements

      Developing innovative pricing structures and alternative fee agreement models that deliver additional value for our clients.

    • Continuing Education

      Advancing professional knowledge and offering credits for attorneys, staff and other professionals.

    • Crisis Advisory

      Helping clients respond correctly when a crisis occurs.

    • DEI Strategic Services

      Providing our clients with legal, strategic, and practical advice to make transformational changes in their organizations.

    • eDiscovery

      Leveraging law and technology to deliver sound solutions.

    • Environmental, Social, and Governance (ESG)

      We help clients create positive return on investments in people, products, and the planet.

    • Global Services

      Delivering seamless service through partnerships across the globe.

    • Innovation

      Leveraging leading-edge technology to guide change and create seamless, collaborative experiences for clients and attorneys.

    • IPED

      Industry-leading conferences focused on affordable housing, tax credits, and more.

    • Legal Project Management

      Providing actionable information to support strategic decision-making.

    • Legally Green

      Teaming with clients to advance sustainable projects, mitigate the effects of climate change, and protect our planet.

    • Nixon Peabody Trust Company

      Offering a range of investment management and fiduciary services.

    • NP Capital Connector

      Bringing together companies and investors for tomorrow’s new deals.

    • NP Second Opinion

      Offering fresh insights on cases that are delayed, over budget, or off-target from the desired resolution.

    • NP Trial

      Courtroom-ready lawyers who can resolve disputes early on clients’ terms or prevail at trial before a judge or jury.

    • Social Impact

      Creating positive impact in our communities through increasing equity, access, and opportunity.

    • Women in Dealmaking

      We provide strategic counsel on complex corporate transactions and unite dynamic women in the dealmaking arena.

    1. Home
    2. Insights
    3. Articles
    4. Value of training datasets in AI Technology

      Articles

    Article

    Value of training datasets in AI Technology

    April 26, 2021

    LinkedInX (Twitter)EmailCopy URL
    UAB “Planner 5D” v. Facebook, Inc. moves forward while copyright application reconsidered

    While many focus on AI algorithms and their outputs, the underlying datasets used to train AI systems and then form the backbone of many systems may be as valuable, if not more so, than the actual AI technology itself. Plaintiff Planner 5D asserts it datasets for “scene-recognition technology” will be worth approximately $50–60 billion over the next five years, and that is just one reason why its case against Facebook and Princeton University over the use and ownership of these datasets will provide important guidance on how and when to protect these valuable datasets.[1]

    In general, scene-recognition technology is the ability of machines to recognize three-dimensional scenes, but the challenge to its development is supplying the data.[2] Planner 5D alleges “that creating lifelike digital scenes is ‘extremely time- and labor-intensive,’ and that to create truly ‘realistic’ scenes, ‘human designers must arrange the objects in real-life configurations.’”[3]

    It’s because of the rarity of this accumulated data, says Planner 5D, that engineers at Princeton University bypassed Planner 5D’s terms and conditions to copy its entire three-dimensional object database—and then publish it as the SUNCG database on a publicly accessible website. After that, according to Planner 5D, Facebook made its own copy of the SUNCG database, then posted another link to that database through a public Stanford University link. Facebook then allegedly published the Stanford link in connection with Facebook’s Scene Understanding and Modelling Challenge (“SUMO Challenge”), seeking submissions of scene-recognition papers and algorithms. Submitters might win cash prizes and a chance to speak at a “SUMO Challenge” conference—in exchange for Facebook’s right to commercialize any submission’s technology and ideas on scene-recognition.

    Planner 5D initially did not register the copyright(s) in its own programs and database. But Planner 5D’s core business objective evolved from providing home design tools. Instead, realizing the value of its compendium of images, Planner 5D sought to become “the leader and innovator in computer scene recognition.”[4]

    Not until after it instituted suit against the defendants did Planner 5D file applications to register the totality of the works created, including both the individual works, as well as the compilation thereof. But the registration process has not been so simple, and the Copyright Office refused the initial applications. Thereafter, Planner 5D sought reconsideration from the Copyright Office.

    Now, in the ruling on the third motion to dismiss in this case, Judge Orrick holds that Planner 5D’s case can proceed on its copyright infringement claim even while the U.S. Copyright Office reconsiders its prior rejection of Planner 5D’s application for registration of its copyright, because all that isrequired is “action” on the application before litigation, not approval.[5]

    This ruling is particularly significant because it is one of the first cases interpreting Fourth Estate Pub. Benefit Corp. v. Wall-Street.com, LLC, 139 S. Ct. 881 (2019), which resolved a circuit split in holding that a copyright must be registered, not just applied for, before filing suit for copyright infringement. Except, according to Judge Orrick, that Fourth Estate does not apply in this action. Instead, the plain text of Section 411(a) permits an infringement action either when “registration of the copyright claim has been made” or when that registration “has been refused.”[6] The defendants argued that while a reconsideration is pending, neither of those two actions has occurred.

    Judge Orrick disagreed. Noting that the pleading stage had continued for nearly two years, he concluded that the case should continue because the statute and prior case law is clear that even if the reconsideration is refused, plaintiffs are entitled to seek the court’s ruling on their entitlement to a copyright registration.

    Without even getting to the merits, this case demonstrates the value of filing copyright registration applications early in their development process to ensure protection of some of the most valuable assets associated with AI technology, i.e., the underlying datasets.


    1. Id. The trade secret misappropriation claim was upheld after the First Amended Complaint.
    2. Id.
    3. Id.
    4. Id.
    5. UAB “Planner 5D” v. Facebook, Inc., Case No. 19-cv-03132-WHO (N.D. Cal. Apr. 14, 2021).
    6. Id, citing 17 U.S.C. § 411(a).
    The foregoing has been prepared for the general information of clients and friends of the firm. It is not meant to provide legal advice with respect to any specific matter and should not be acted upon without professional counsel. If you have any questions or require any further information regarding these or other related matters, please contact your regular Nixon Peabody LLP representative. This material may be considered advertising under certain rules of professional conduct.

    Subscribe to stay informed of the latest legal news, alerts, and business trends.Subscribe

    • People
    • Capabilities
    • Insights
    • About
    • Locations
    • Events
    • Careers
    • Alumni
    • Cookie Preferences
    • Privacy Policy
    • Terms of Use
    • Accessibility Statement
    • Statement of Client Rights
    • Purchase Order Terms & Conditions
    • Nixon Peabody International LLC
    • PAL
    © 2025 Nixon Peabody. All rights reserved