Contributed by Calpont, InfiniDB Community Edition is an open source, scale-up analytics database engine for your data warehousing, business intelligence and read-intensive application needs. Enabled via MySQLTM and purpose-built for an analytical workload with column-oriented technology at its core, the multi-threaded capabilities of InfiniDB Community Edition fully encompass query, transactional support and bulk load operations.  So come on in, grab a download and get started.

             | 

Message
  • You must login and be authorized to access this document.
  • Not authorized
Welcome, Guest
Username Password: Remember me

concurrent DML / DDL
(1 viewing) (1) Guest
  • Page:
  • 1

TOPIC: concurrent DML / DDL

concurrent DML / DDL 1 year, 12 months ago #253

  • srand
  • OFFLINE
  • Fresh Boarder
  • Posts: 11
  • Karma: 0
We're thinking about migrating our datawarehouse from MySQL to InfiniDB, but as users provide our datawarehouse, we need concurrent DML and this is a crucial point !

thank you for your work

Re: concurrent DML / DDL 2 months, 2 weeks ago #2731

I was planning to migrate our data warehouse to InfiniDB from Oracle but is mandatory to have this capabilities.

How do you espect that we use ETl with this limitation? It´s impossible....
Last Edit: 2 months, 2 weeks ago by ricardo.edo.

Re: concurrent DML / DDL 2 months, 2 weeks ago #2736

  • radams
  • OFFLINE
  • Moderator
  • Posts: 220
  • Karma: 3
Hi,

Execution of concurrent DDL/DML statements is not support in the current release of the Calpont
InfiniDB. Additional transactions beyond the first will wait until the first transaction has committed before executing.

We do not recommend using DML to load data into InfinDB. DML is a row by row process and is therefore very slow. We have a tool called cpimport which is capable of loading a very large number of rows into the database. Please check out our Concepts Guide to see how this works.

Thanks,

Robert
Calpont
Last Edit: 2 months, 1 week ago by radams.

Re: concurrent DML / DDL 2 months, 2 weeks ago #2737

thanks for your reply.

I know cpimport but it is insufficient to populate a data warehouse every day, for example, to load slowly changing dimensions or to refresh dimensions and fact tables in the same transformation.

I have been testing InfiniDB with my data and the query response is impresive vs my database using R-OLAP cubes, I get near instant response vs several minutes, but it´s imposible to put this database on a production enviroment with our etl processes with this limitation.

Re: concurrent DML / DDL 2 months, 1 week ago #2740

  • radams
  • OFFLINE
  • Moderator
  • Posts: 220
  • Karma: 3
Hi,

We have quite a few customers who have found that by using the flexibility that InfiniDB provides they can quite easily adapt their process to work very efficiently.

Here is an article that describes how that can work.

www.infinidb.org/component/content/article/53/225


Thanks,

Robert
  • Page:
  • 1
Time to create page: 0.38 seconds